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Abstract 

It is well known that there is a one-to-one correspondence between the entropy vector of a collection 
of n random variables and a certain group-characterizable vector obtained from a finite group and n 
of its subgroups [fl]. However, if one restricts attention to abelian groups then not all entropy vectors 
can be obtained. This is an explanation for the fact shown by Dougherty et al |2| that linear network 
codes cannot achieve capacity in general network coding problems (since linear network codes form an 
abelian group). All abelian group-characterizable vectors, and by fiat all entropy vectors generated by 
linear network codes, satisfy a linear inequality called the Ingleton inequality. In this paper, we study the 
problem of finding nonabelian finite groups that yield characterizable vectors which violate the Ingleton 
inequality. Using a refined computer search, we find the symmetric group ^5 to be the smallest group that 
violates the Ingleton inequality. Careful study of the structure of this group, and its subgroups, reveals 
that it belongs to the Ingleton-violating family PGL{2,p) with primes p > 5, i.e., the projective group 
of 2 X 2 nonsingular matrices with entries in ¥p. This family of groups is therefore a good candidate for 
constructing network codes more powerful than linear network codes. 
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I. Introduction 

Let A/" = {1, 2, ... , n}, and let Xi,X2, . . . , X„ be n jointly distributed discrete random variables. For 
any nonempty set a C J\f, let Xq, denote the collection of random variables {Xi : i G a}, with joint 
entropy K = H{Xa) = H{Xi] i e a). We call the ordered real (2" - l)-tuple (/i^ : 7^ a C TV) G 
"^^ an entropy vector. The set of all entropy vectors derived from n jointly distributed discrete random 
variables is denoted by F* . It is not too difficult to show that the closure of this set, i.e., F* , is a convex 
cone. 

The set F* figures prominently in information theory since it describes the possible values that the joint 
entropies of a collection of n discrete random variables can obtain. From a practical point of view, it is of 
importance since it can be shown that the capacity region of any arbitrary multi-source multi-sink wired 
network, whose graph is acyclic and whose links are discrete memoryless channels, can be obtained by 
optimizing a linear function of the entropy vector over the convex cone F* and a set of linear constraints 
(defined by the network) 131, H. Despite this importance, the entropy region F* is only known for 
n = 2, 3 random variables and remains unknown for n > 4 random variables. Nonetheless, there are 
important connections known between F* and matroid theory (since entropy is a submodular function 
and therefore somehow defines a matroid) [5|, determinantal inequaUties (through the connection with 
Gaussian random variables) Q, and quasi-uniform arrays Q. However, perhaps most intriguing is the 
connection to finite groups which we briefly elaborate below. 

A. Groups and Entropy 

Let G be a finite group, and let Gi, G2, . . . , G„ be n of its subgroups. For any nonempty set a C J\f, 
the group Gq = Higa ^ subgroup of G. Let \K\ be the order (cardinality) of a group K, and 

define = log |^^. We call the ordered real (2" — l)-tuple {ga : / a C A/") G M^"^^ a (finite) group 
characterizable vector. Let T„ be the set of all group characterizable vectors derived from n subgroups 
of a finite group. 

The major result shown by Chan and Yeung in HI is that F* = cone(T„), i.e., the closure of F* is 
the same as the closure of the cone generated by T„. In other words, every group characterizable vector 
is an entropy vector, whereas every entropy vector is arbitrarily close to a scaled version of some group 
characterizable vector. 

To show the first part of this statement, let A be a random variable uniformly distributed on the 



elements of G. Define Xi = AGij for i = l,...,n, then Xi is uniformly distributed on G/Gi and 
H{Xi) = log To calculate the joint entropy ha = H{Xa) for a nonempty subset a C Af, let 
denotes the set of all coset tuples {{xGi : i G a) \ x £ G}. Consider the intersection mapping 

Qa{xGi : i G a) = Pi xGi = xGa- (1) 

@a is a well defined onto function on X^, and it is one-to-one since if {xGi : i G a) and {x'Gi : i £ a) 
are mapped to the same coset xGa = x'Ga, then x~^x' S Ga and so x~^x' G Gi for all i, which implies 

(xGi : i e a) = (x'Gi : i e a). So H{Xa) = H{Qa{^a)), and as Qai^a) = AGq,, we have 

K = HiOaiXa)) = log = ga. 

\^a\ 

Thus indeed every group-characterizable vector is an entropy vector. Showing the other direction, i.e., 
that every entropy vector can be approximated by a scaled group-characterizable vector is more tricky 
(the interested reader may consult 11] for the details). Here we shall briefly describe the intuition. 

Consider a random variable Xi with alphabet size and probability mass function {pi,i = 1, . . . , N}. 
Now if we make T copies of this random variable to make sequences of length T, the entropy of Xi is 
roughly equal to the logarithm of the number of typical sequences. These are sequences where Xi takes 
its first value roughly Tpi times, its second value roughly Tp2 times and so on. Therefore assuming that 
T is large enough so that the Tpi are close to integers (otherwise, we have to round things) we may 
roughly write 

1 / T 

H{X,)^-log 



T 



Tpi Tp2 . . . TpN-i TpN 



where the argument inside the log is the usual multinomial coefficient. Written in terms of factorials this 



IS 



If we consider the group G to be the symmetric group St, i.e., the group of permutations among 
T objects, then clearly |G| = Tl. Now partition the T objects into N sets each with Tpi to Tp^ 
elements, respectively, and define the group Gi to be the subgroup of St that permutes these objects 

while respecting the partition. Clearly, |Gi| = {Tpi)\{Tp2)\ ■ ■ ■ {Tpn)\, which is the denominator in ([2]). 

1 \G\ 

Thus, H{Xi) ^ log so that the entropy /iji} is a scaled version of the group-characterizable gs^iy 
This argument can be made more precise and can be extended to n random variables — see HJ for the 



'The left coset of d in G with representative A. See section |II] for the group theory notations used in this paper. 
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details. We note, in passing, that this construction often needs T to be very large, so that the group G 
and the subgroups Gi are huge. 

B. The Ingleton Inequality 

As mentioned earlier, entropy satisfies submodularity and therefore, with some care, defines a matroid. 
Matroids are defined by a ground set and a rank function, defined over subsets of the ground set, that 
satisfies submodularity. They were defined in a way to extend the notion of a collection of vectors (in 
some vector space) along with the usual definition of the rank. A matroid is called representable if 
its ground set can be represented as a collection of vectors (defined over some finite field) along with 
the usual rank function. Determining whether a matroid is representable or not is, in general, an open 
problem. 

Let n = A, N = {1, 2, 3, 4}. In 1971 Ingleton showed that the rank function r|.} of any representable 
matriod must satisfy the inequality lH 

ri2 + ri2. + ri4 + r23 + r24 > ri + r2 + + ri23 + ri24, 

where for simplicity we write r^j and rijk for j} and r{j j ^j, respectively. However, it turns out 
that there are entropy vectors that violate the Ingleton inequality 111, so that entropy is generally not 
a representable matroid. Using non-representable matroids, ||3 constructs network coding problems that 
cannot be solved by linear network codes (since linear network codes are, by definition, representable). 

As r* = cone(T„), we know there must exist finite groups, and corresponding subgroups, such that 
their induced group-characterizable vectors violate the Ingleton inequality. In fTOl it was shown that 
abelian groups cannot violate the Ingleton inequality, thereby giving an alternative proof as to why linear 
network codes cannot achieve capacity on arbitrary networks — they form an abelian group. So we need 
to focus on non-abelian groups and their connections to nonlinear codes. 

Finally, we write down the Ingleton inequality for entropy vectors, and translate it to the context of 
finite groups as follows: 

hl2 + /lis + hu + /l23 + >hi + h2 + /l34 + /ll23 + /ll24, (3) 
IG1IIG2IIG34IIG123IIG124I > |G'i2||Gi3||Gi4j|G23||G24|- (4) 

C. Group Network Codes 

A communication network is usually represented by a directed acyclic graph G = (V,£), where the 
node set V and the edge set £ model the communication nodes and channels respectively. Let 5 C V be 
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the set of source nodes, be the set of sink nodes demanding source s G 5. For any node v and any 
edge e, X{v) and Z(e) denote the sets of incoming edges to v and to the tail node of e, respectively. 
A network code should include 

1) the assignment of a symbol K, from some alphabet at each source node s; 

2) the encoding of a symbol Yg in some alphabet y^. at each edge e, from the symbols on T{e). 
Namely, = ipe {Yf : / G I{e)) for some deterministic encoding function (pe', 

3) the decoding of the symbol Ys at each u G 'D(s) for all sources s, i.e. Yg is uniquely determined 
from the symbols on Z{u): Yg = (j)u,s{Yf : / G '^{u)) for some decoding function 4)u,s- 

It is clear that at each edge e the symbol Yg is a deterministic function of the source symbols {Yg : s G 
S}, which is denoted by and is called the global mapping at e. Also the source random variables 
{Yg : s G <S} are usually assumed to be independent and uniform on their respective alphabets. 

For example, a linear network code is defined as follows: 1) for each t ^ S U £, the alphabet yt is a 
vector space F'^* over a finite field F with some finite dimension du 2) all encoding/decoding functions 
are linear: if t is an edge or a sink node, then the encoding/decoding function (pt at t can be written as 

c^t{Yf:feI{t))= MtjYf 

for some matrices Mtj. Thus the global mappings at the edges are also linear. 

Group network codes were first proposed by Chan in ifTTl . |[T2l by considering the fact that finite 
groups can generate the whole entropy region, and noting that linear network codes are simply a special 
case. Suppose G is a finite group, and that {Ge : e G f } and {Gg : s G 5} are some of its subgroups. 
One can construct a network code with yt = G/Gt for each t ^ S\J £, such that the entropy vector for 
{Yt : t G 5 U £"} is characterizable by the group G and its subgroups {Gt : t G 5 U £}, if the following 
requirements are met. 

(Rl) Source independence: the cardinalities of G/Gs and Hses (the Cartesian product of the source 

alphabets) are equal, where Gs — flses^s- ^^^^ equivalent to HsgS ~ \G\^^^^'^\Gs\- 
(R2) Encoding: Ve G £, nfex(e) ^/ — ^e- 
(R3) Decoding: Vs G S, n/ex(u) — ^^'^h ^ ^(s)- 

To establish the encoding and decoding process, we need an auxiliary lemma. 
Lemma 1: Let Ki, K2 be two subgroups of G with Ki < K2. Then the coset mapping 

TT : G/Ki G/K2 

(5) 

xKi XK2 
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is a well defined onto function, where xKi is mapped to the unique coset in G/K2 that contains it. 
Furthermore, if Ai is a uniform random variable on G/ Ki, then 7r(Ai) is uniform on G/K2. 

Proof: vr is well defined since XK2 = x'K2 whenever xKi = x'Ki. Note that K2 is partitioned 
by the m distinct cosets {yiKi : 1 < i < m}, where m = \K2/Ki\ and yi E K2 for i = 1, 2, . . . , m. 
Therefore, each XK2 € G/K2 is also partitioned by the m cosets {{xyi)Ki : 1 < i < m}, which are 
precisely the m preimages of XK2 under vr. Thus 7r(Ai) is uniform on G/K2. ■ 
For any collection a of subgroups of G, the intersection mapping ([U is a bijection. Consider the 
collection of all source subgroups. Let Xg = {{xGg : s S 5) | x G G}, then we have the bijective 
intersection mapping G5 : Xs G/Gs- But with (Rl), IriseS-^^l ~ \G/Gs\ = \Xs\ and so 
Xs = WseS^s- This means that any coset tuple {xgGg : s G 5) in Hses^s can be represented in 
the form {xGg : s E 5) for a common x £ G, and the intersection of {xgGs : s G 5} is equal to xGg. 
Therefore, we can rewrite the bijection 65 as 

Qs'-llys^G/Gs, 

which maps a tuple to the intersection of all its cosets. 

Moreover, let t be an edge or a sink node, define Xx(^t) = ii^Gf : f G I{t)) | x G G} and 
G'x(t) = r\fex{t) Gf- Then the intersection mapping 

: -^1(1) G/ Gx(t) 

is a bijection. With (R2) and (R3), we can also define coset mappings for edges and source/sink pairs as 
follows. For each edge e, since Gx[e) < Ce by (R2), define the coset mapping vrg as (|5]l with Ki = Gx(e) 
and K2 = Ge- While for each source s with u G 'D{s), since Gx[u) ^ Gg by (R3), similarly define vr^j ^ 
with Ki = Gx[u) ^rid K2 = Gs- 

Now we can define the encoding and decoding functions. At each edge e, let the encoding function 
be (/)(, = TTeO 0j(e)- Fof cach source s with u G I'(s), let the decoding function be 4'u,s = t^u,s ° ®i{u)- 
In other words, at an edge or a sink node t, the encoding/decoding function takes an input coset tuple 
(Yf : f G and first forms the intersection of all its cosets, which is a coset of Gx[t), then maps 

this coset to the unique coset of Ge (or Gs, whichever is appropriate) that contains it. Such network 
operations define a proper network code, since by the proposition below the decoding functions always 
yield correct source symbols at each sink node. 

Proposition 1: Assume (Rl) holds, and let the encoding and decoding functions be defined as above. 
Then for some common x G G, £ S, Ys = xGg and Ve G Ye = xGe- Also for each source s with 
u G T>{s), Yg is recovered by the decoding function (t)u,s- 
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Proof: Let the source symbols {Yg : s € 5) be an arbitrary tuple from Hsgs^s- Since (Rl) is true, 
as discussed above, for all s ^ S, Yg = xGg with a common x € G. As is directed and acyclic, we 
can define the "depth" of each node v as the length of the longest path from a source node to v, and 
define the depth of an edge to be the depth of its tail node. Note that e is always "deeper" than / if 
/ € X(e). Also if Yf = xGf for all / G X(e), then Y^ = (pe{Yf : f € X(e)) = xGe- So by induction on 
the depths of the edges, Y^ = xGe for all e € f . 

Furthermore, for each s £ S with u € 'D{s), since Yf = xGj for all / S T{u), (t)u,s{Yf '■ f £ ^i^)) = 
xGg = Yg. Thus the source symbol Yg is successfully recovered at u. ■ 

Remark 1: Note that the encoding/decoding function for an edge or a sink node t is only defined 
on Xx{t), but not on the entire Cartesian product H/exCt) •^f- ^^^^ is because for an arbitrary tuple in 
n/Gi(t) >^/' i*- i^ possible that the intersection of all cosets is the empty set, which is not a coset of Gx[t)- 
However, with (Rl) this is not a problem, as Proposition [T] guarantees that (Yy : / e I{t)) is always a 
tuple in Xx^ty 

Remark 2: From the proof above, even without (Rl) these encoding and decoding functions still 
constitute a valid network code, if the sources cooperate in such a way that the transmit tuples are 
always from X^- But in this case the source random variables are dependent. 

Next we analyze the global mappings of this group network code, and show that the entropy vector 
is characterizable by the group G and its subgroups {Gt : t £ S U £} when the sources are independent 
and uniform. First we give another auxiliary lemma. 

Lemma 2: Let K < G and let Gj, i = 1, . . . , n, be subgroups of G containing K. For each i let vTj 
be the coset mapping defined as (|5]l with Ki = K and K2 = Gi. Let Kk be a uniform random variable 
on G/K, and define Xi = ■Ki{KK) for each i. Then the entropy vector of {Xi,X2, ■ ■ ■ ,Xn} is exactly 
the group characterizable vector induced by G and {Gi, G2, . . . , G„}. 

Proof: For each nonempty subset a C J\f, since K < Ga, we can define the coset mapping tTq, 
with K and Ga- As in Section iLAl the alphabet of X^ is still Xa = {{xGi : i £ a) \ x G G}, and 
the intersection mapping 0q, is a bijection. Also @a{Xa) = T^ai^K), which is uniform on G/Ga by 
Lemma [T] So the joint entropy H{Xa) = H{Qa{Xa)) = log and the lemma follows. ■ 



For each s £ S define the coset mapping Tr'g as dD with Ki = Gs and K2 = Gg. For every edge e 
we can similarly define a new coset mapping vTg with Ki = G5 and K2 = Gg, since according to the 
following proposition, G5 < Gg. 

Proposition 2: If (R2) is satisfied, then Ve G £, Gs < Gg. 

Proof: The proposition is trivially true if e is emitted from a source node. Also if Gs < Gj for all 
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/ E X(e), then by (R2) we have Gs < Gg. Similar to Proposition [T] by induction on the depths of the 
edges the proof follows. ■ 
Proposition 3: Ve E £, the global mapping at e for the above group network code is ip^ = tt'^o B5. In 
other words, first forms the intersection of all the source cosets to obtain a coset of Gx{t), and then 
maps this coset to the unique coset of containing it. 

Proof: Assume the source symbols {Ys : s E 5) are transmitted and let A5 = @s0^s : s E 5). Then 
A5 = xGs for some x E G, and Yg = xGg = 7r^(A5) for all s E 5. By Proposition [T] Y^. = xGe = 

Tl'ei^s), SO = vr^ o 65. ■ 

Let the source random variables {Yg : s E 5} be independent and uniformly distributed, so the joint 
distribution is uniform on Hses-^*- L^*- = ©5(^8 : s E S), then A5 is uniform on G/Gs as Qs 
is bijective. From Proposition [3j Vt E 5 U = ■k[{Ks), and so by Lemma |2j the entropy vector for 
{Yt : t E 5 U £"} is characterizable by the group G and its subgroups {Gt : t E 5 U £}. 

Remark 3: For linear network codes, the global mappings are linear functions on the direct sum V of 
all source vector spaces. As the underlying field is finite, V is a. finite abelian group. Let G = V, Gg be 
the subspace spanned by all source vectors from S \ {s}, Gg be the null space of the global mapping at 
e. Then the linear network code is indeed realized as a group network code. We shall elaborate on this 
point in Section IVII-AI 

D. Discussion 

Since we know of distributions whose entropy vector violates the Ingleton inequality, we can, in 
principle, construct finite groups whose group-characterizable vectors violate Ingleton. Two such dis- 
tributions are Example 1 in |[T3l . where the underlying distribution is uniform over 7 points and the 
random variables correspond to different partitions of these seven points, and the example on page 1445 
of |[T4l . constructed from finite projective geometry and where the underlying distribution is uniform over 
12 X 13 = 156 points. Unfortunately, constructing groups and subgroups for these distributions using the 
recipe of Section |LA] results in T = 29 x 7 = 203 and T = 23 x 156 = 3588, which results in groups 
of size 203! and 3588!, which are too huge to give us any insight whatsoever. 

These discussions lead us to the following questions. 

1) Could the connection between entropy and groups be a red herring? Are the interesting groups too 
large to give any insight into the problem (e.g., the conditions for the Ingleton inequality to be 
violated)? 
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2) What is the smallest group with subgroups that violates the Ingleton inequahty? Does it have any 
special structure? 

3) Can one construct network codes from such Ingleton-violating groups? 

In this paper we address the first two questions. We identify the smallest group that violates the Ingleton 
inequality — it is the symmetric group 5*5, with 120 elements. Through a thorough investigation of the 
structure of its subgroups we conclude that it belongs to the family of groups PGL{2,p), with p a prime 
greater than or equal to 5. (PGL{2, 5) is isomorphic to S5.) We therefore believe that the connection to 
groups is not a red herring and that there may be some benefit to it. 

The exphcit nature of PGL{2,p) may lend itself to effective network codes. We only mention that 
non-abelian groups allow for much more flexibiUty in the design of codes. For example, if the incoming 
messages to a node in the network, a and b, say, are elements from a nonabelian group then the operations 
a^b, aba, ba^, say, can potentially all correspond to different elements in the group, whereas in the abelian 
case they all coincide with a'^b. Therefore nodes in a network will have much more choices in terms 
of what to transmit on their outgoing edges — and this should, ostensibly, be what allows one to achieve 
capacity. The drawback is, of course, that decoding becomes more complicated than solving a system of 
linear equations. 

We shall not say anymore about codes. What we will do in the remainder of the paper is to describe 
how we found the smallest Ingleton-violating group and how we uncovered its structure. This required the 
identification of conditions beyond being abehan that force a group to respect Ingleton. It also required 
a deep study of the 120 element group that we found via computer search. We now present the details. 



II. Notation 



We use the following abstract algebra notations throughout this paper: 



|G| 



the order of group G. 

the group G is isomorphic to the group H. 

H is a subgroup of G. 

H is a normal subgroup of G. 

the left coset of the subgroup H in G with representative g. 

the set of all left cosets of subgroup H in G. When H < G, G/H is a group. 

(Factor or quotient group) 



G^H 



H <G 



H <G 



G/H 



\9\ 



the order of element g = smallest positive integer m s.t. g"^ = 1. 
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the conjugate of element x by element g in G: x^ = g xg. (No confusion with 
the powers of x as 5 is an element of G.) 

the conjugate of subset X by element g in G: X^ = {x^ : x G X}. 
HK or: H K the "set product" of H,K Q G: HK = {hk:h€H,k€ K}. 
H X K the direct product of groups H and K. 

the direct product of n copies of the group G. 
H X K the semidirect product of groups H and K. 

{gi,-- - , 9m) ^ {S) the group generated by the elements 51, ... , and by the set S. 
G = {S\R) {S\R) is a presentation of G. S is a set of generators of G, while i? is a set of 

relations G should satisfy. 
1 the natural number "1", identity element of a group, or the trivial group. The 

meaning should be clear in different contexts with no confusion. 
Z„ the integers modulo n = the cyclic group of order n. 

Sn the symmetric group of degree n = all permutations on n points. 

D2n the dihedral group of order 2n. 

the finite field of q elements. 
Z^, the multiplicative group of units of Z„, and of F^. F^ = all nonzero elements of 

F 

GL{n,q) the general hnear group of all invertible n x n matrices with entries from ¥q. 

The identity element for GL{n,q) is usually denoted by 7 = identity matrix. 

\GLin,q)\ = (g- - l)(g" - - q^) ■ ■ ■ (g« - g^-^). 

Vq the center of GL{n,q) - all nonzero scalar matrices - {al : a € }. 

PGL{n,q) the projective general linear group = GL(n,gf)/Fq. \PGL{n,q)\ = \GL{n,q)\/\Vq\ 

\GLin,q)\/iq-l). 

SL{2, q) the special linear group = all matrices in GL{2, q) with determinant 1. \SL{2, q)\ = 

\PGL{2,q)\. 

PSL{2, q) the projective special linear group = SL{2, q)/{-I). \PSL{2, q)\ = \SL{2, g)|/2. 



To simplify expressions in later sections, let /C„ = {0, 1, . . . , n — 2} for integers n>2. 

III. Computer Search and Some Negative Conditions 

Designing a small admissible structure for an Ingleton-violating group G and its subgroups is very 
difficult without an existing example, so we use computer programs to search for a small instance. We 
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use the GAP system |[T5l to search its "Small Group" library, which contains all finite groups of order 
less than or equal to 2000, except those of 1024. We pick a group in this library, find all its subgroups, 
then test the Ingleton inequality for all 4-combinations of these subgroups. This is a tremendous task, as 
there are already more than 1000 groups of order less than or equal to 100, up to isomorphism, each of 
which might have hundreds of subgroups (some even have more than 1000). 

It was therefore extremely critical to prune our search. In fact, we used the following negative 
conditions, each of which guarantees that Ingleton is not violated. 

Condition 1: G is abelian. ifTOl 

Condition 2: d < G, Vz. (Hi 

Condition 3: G1G2 = G2G1, or equivalently G1G2 < G. 
Condition 4: Gj = 1 or G, for some i. 
Condition 5: Gi = Gj for some distinct i and j. 
Condition 6: G12 = 1. 

Condition 7: Gi < Gj for some distinct i and j. 

Remark 4: Condition |2] subsumes Condition [TJ while Condition [3] subsumes Condition [2l Also Con- 
ditions |4] and |5] are contained in Condition |7J 

The proofs for Conditions [3l |6] and |7] are listed below: 

Proof \3\ Construct random variables Xj's from uniformly distributed A on G as in Section IPAl 
As Gi;2 — G1G2 < G, we can similarly construct random variable Xi-2 = AGi;2. Note that |Gi;2| = 
IG1IIG2I/IG12I, H{Xi.2\Xi) = H{Xi.2\X2) = as Gi,G2 < Gi;2. Similar to the proof of Condition!! 
in |[T6l . we use the following information inequality in ifTTll : 

2H{E\A) + 2H{E\B) + I{A; B\C) + I{A; B\D) + /(G; D) > H{E). 

Plugging m A = Xi, B = X2, C = X3, D = and E = X\-^2 we can easily deduce Ingleton 
inequality. ■ 

Remark 5: In the proof above we used the aforementioned group-entropy correspondence to translate 
the problem to the entropy domain. Henceforth, in order to show that a group satisfies Ingleton, we shall 
either prove ^ directly, or equivalently prove Q using this correspondence. 

Observe that the Ingleton inequality has symmetries between subscripts 1 and 2 and between 3 and 
4, i.e. if we interchange the subscripts 1 and 2, or 3 and 4, the inequality stays the same. Thus if we 
prove conditions for some i G {1,2} and j G {3,4}, we automatically get conditions for all € 
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{1,2} X {3,4}. So without loss of generality, we will just prove conditions for the case = (1,3) 
when these symmetries apply. 

Pwof^ Realize that Q can be rewritten as 

(^13, 14 + <^23,24 + <^134,234 — (5123,124 > 0, (6) 

where 5a,i3 = K + hi3 - Knp - Kyjis for / a,/3 C TV. (e.g., 5134,234 = /ii34 + /i234 - h^A - /ii234-) 
By submodularity, all da^p > 0. If G12 = 1, then (5i23,i24 = and ^ holds. ■ 
Proof ^ = (1,2) implies Condition O (1,3) implies 5i23,i24 = in Q. (3,1) implies 

(5123,234 = and so (5i23,234 < ^12,24, which further implies (5i23,i24 < '523,24> thus Q holds. For (3,4), 
(01) becomes IG1IIG2IIG3IIG123IIG124I > 1^1211^1311^1411^23110241, which follows from |Gi||Gi24| > 
1 0*12 [ I Gu I , IG3IIG123I > IG13IIG23I and G2 > G24- ■ 

Remark 6: Conditions [6] and |7] were first pointed out to us by Prof. M. Aschbacher using group 
theoretic techniques. The proofs presented above are based on the submodularity property of entropy. 

Remark 7: Conditions [T] [3] and [6] are crucial in our searching program, as they appear in the outer 
searching loops and can reduce a large amount of work. 

IV. The Smallest Violation Instance and Its Structure 

Using GAP we found the smallest group that violates Ingleton is G = ^5. There are 60 sets of violating 
subgroups up to subscript symmetries. Furthermore, these 60 sets of subgroups are all conjugates of each 
other. Thus in terms of group structure, these instances are virtually the same. We list below some 



13 



information from GAP about one representative 



Gi = ((3,4,5),(1,2)(4,5)) ^ S3 ^ Dq 
G2 = ((1,2, 3, 4, 5), (1,4, 3, 5)) ^ Z5 x Z4 

G3 = ((2,3),(l,3,4,2)) ^Ds 

G4 = ((2,4),(1,2,5,4)) ^Ds 
Gi2 = ((l,2)(3,5)) 
Gi3 = ((l,2)(3,4)) 

Gi4 = ((l,2)(4,5)) ^Z2 
G23 = ((1,3,4,2)) 

G24 = ((1,2,5,4)) ^Z4 

G34 = l 
G123 = 1 
1 



Gil 
G2I 

^31 

G4I 

G12 

Gi3 
Gl4 

G23 
G24 
G34 

G123 
G124 



6 

20 

8 
8 

= 2 
= 2 
= 2 
= 4 
= 4 
= 1 
= 1 
= 1 



120 < 128 = IG12IIG13IIG14IIG23IIG24I, Ingleton is violated. Also, 



G124 - 

As IG1IIG2IIG34IIG123IIG124I 
G1-G4 generate = 85. 

To illustrate the structure of these subgroups, we use the group cycle graph. See Fig. [H where the 
dash-dotted lines denote the pairwise intersections of subgroups excluding identity. From the cycle graph 
we can obtain more structural information which GAP does not show us directly. First, not only is G2 
a semidirect product of two cyclic groups ((1,2,3,4,5)) = Z5 and ((1,4,3,5)) = Z4 (in particular, 
it's metacyclic), but also (G2 \ ((1, 2, 3, 4, 5))) 1J{1} is the union of subgroups which are all isomorphic 
to ((1,4,3,5)) (actually they are all conjugates of ((1,4,3,5))) and have trivial pairwise intersections. 
(In this case we say G2 has a "flower" structure.) Second, G4 is the conjugate of G3 by (3,4,5). In 
particular, (1, 3, 4, 2)(3'4,5) = (1,4,5,2) = (l,2,5,4)-i. 

In order to generalize these subgroups to a family of violations, we seek a group presentation for them. 
Observe that IG23I and [G24[ (both equal to 4) contribute most to the right-hand side (RHS) of (01), so 
we may try to let the "petals" of G2 (conjugates of ((1,4,3,5))) grow while keeping other structures 
fixed. (This is a little conservative, but it is the only successful extension according to our GAP trials. For 
example, one may try to expand Gi at the same time, but the structures of G3 and G4 usually collapse.) 



^The permutations are written in cycle notation, e.g. (1, 2)(3, 4, 5) is the permutation on the set {1, 2, 3, 4, 5} that makes the 
following mapping: 1 h-^ 2, 2 1— > 1, 3 n> 4, 4 5, 5 n- 3. Also GAP's convention for permutations is used throughout this 
paper, i.e. permutations are applied to an element from the right. 
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G2 

Fig. 1. The cycle graph of the Ingleton violating subgroups of 5*5 



We assume that G2 is generated by two elements a and b with a normal subgroup N = {a) = Z„, as 
well as a subgroup H = (b) = Z^, for some integers m, n. This gives us a presentation 

G2 = (a,6|a" = 6"* = 1, a'' = a") (7) 

for some < s < re. In order to violate Ingleton as much as possible, we may wish for re to be small 
while m is large. However, the flower structure of G2 may limit the choices of re and m. First of all, for 
this presentation to be a semidirect product, we need s"^ = 1 (mod re) (see ifTSl Sec 5.4]), i.e., s G 
with |s| I m. As a consequence, 16*21 = mn, Hf]N = 1, and (a*)'''' = a^^'^ for any integers i and k. 
Moreover, we need (G2 \ N) IJ{1} to be the union of groups which are all isomorphic to H with trivial 
pairwise intersections. 

One possible way to achieve this is to restrict H^^ f]H3^ = 1, Vgi ^ §2 ^ as in our original 
construction. This is equivalent to f]H = 1, \/g G A^\{1}. If this is the case, there will be |A^| = n 
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"petals" of size m in G2, and the total number of nonidentity elements will equal n(m — 1) = nm — n = 
IG2 \ A^|, then indeed the flower structure would be achieved. 

Pick two nonidentity elements /ii = 6' G H, /i2 = {b^Y' € H"^' for some < /c, / < m, < i < n. 
Then 

hi = h2 ^ a-%^a' = b^ ^ a-\a^fb^ = b^ ^ a-V""' = 6'"'= ^ a^""'"^)* = 6'"^ 

As //pi = 1, this is equivalent to a*^* '^-^y = jji-k _ j g i _ n\{s~^ — To guarantee that 

Pi i7 = 1 , we must have m < \s\. Otherwise if we let < /c = \s\ < m, then s"'^ = 1 (mod n) 
and so n[(s^^ — l)i ; therefore we can find a nonidentity element hi = b^ = {b^Y^ = /12 in fl ^• 
Now, since m < \s\ and |s| | m, we must have m = \s\. In particular, m < |Z^ | < n. 

For m to be as large as possible, s should be a primitive root modulo n, which makes m = |Z^|. 
Furthermore, since m < n — 1, we can achieve the upper bound on m (w.r.t. n) when n = p, for some 
prime p > 2. (We need p > 2 for the petals not to collapse.) In this case m = |Zp \ = p — 1. Also if 
< A; < m = |s|, < i < n = p, then n|(s~'^ — l)i requires p\i or p\{s^^ — 1). Since p > i, the latter 
must be true, which implies that |s| \k. But this is a contradiction since < < |s|. So actually we have 
f] H = 1, yg £ N, and the flower structure is realized. In this case the presentation of G2 becomes 

G2 = {a,b\aP = lf-^ = l,a^ = a') (8) 

where p > 2 is a prime, s is a primitive root modulo p. 

The next step is to extend this presentation to the whole group G generated by G1-G4, with the 
structure in Fig. [T] Consider the dihedral groups G3 and G4. The subgroups of rotations are just H"^^ 
and i?"* respectively, for some 03 = a*^^ , 04 = a'^* S N. Also G3 and G4 each shares one element of 
reflection with the dihedral group Gi, while the remaining reflection of Gi is just {b^)""^ in G2, for 
some oi = a^^ E A^. Thus if we can determine the generator of the subgroup of rotations of Gi, then 
all elements of G1-G4 are determined. In other words, if we introduce an element c as the generator of 
rotations of Gi, then all elements from G1-G4 can be express as products of a,b,c and their inverses. 
To simplify our expressions, define 

bi = {b'^f\ 63 = 6"''% 64 = 6"''^ (9) 

for some integers ki, k^, k^. If in Fig. [T]we let a, b, c, 61, 63, 64 correspond with (1, 2, 3, 4, 5), (1, 4, 3, 5), 
(3,4,5), (1,2)(3, 5), (1,3,4,2), (1,2,5,4) respectively, then the subgroups and the whole group in our 
presentation should be 

Gi = (c,6i), G2 = (a,6), G3 = (bic^, 63), G4 = (610,64), G = (a,6,c). (10) 



16 



As Gi = Dq, we should have the relation = (c&i)^ = 1. For G3 and G4 to be dihedral groups, we 
need (^3 • bic^f = (64 • hcf = 1. 

Observe that in the original violation, G4 is the conjugate of G3 by (3,4,5), and (1, 3, 4, 2)^^'^'^) = 
(1, 2, 5, 4)^^. In our presentation this translates to 63 = b^^. We claim this relation makes (63 • 61 c^)^ = 
(64 ■ 6ic)^ = 1 if and only if — ki = ki — k^ (mod p). As |fei| = 2, = (c6i)^ = 1, we have 
cbi = bic^ and bic = c^bi. From the new relation we can establish the following equalities: 

(63 • bic^f = bsbic^'^bscbi = 636164 ^61, 

(64 . bicf = bibicbic-^bi = 64616^^61 = ((636164 ^6i)-^)''\ 

So (63 • 61 c^)^ = 1 if and only if (64 • 6ic)^ = 1. Plugging in Q and using (a*)''*' = a**'' we have 

(63 . bic^f = a[(fc3-fei)+(fci-fc4)s(''-i)/=^](s-i-i)_ 

Since s is a primitive root modulo p, = 2. As is cyclic of an even order p — 1, it is clear 

that there is a unique element of order 2. Also the order of —1 in is 2, so s^p^^)/^ = —1 (mod p), 
and 

(63 . bic^f = a[('=='-*=i)"(^i-'^'*)l(""'-^). 

Now p \ {s^^ — 1) as s 7^ 1, so 

(63-610^)^ = 1 <^ p\[{k3 - ki) - {ki - ki)] k^-ki=ki-ki (mod p). 

The above condition tells us that the petals G23 and G24 of G2 should be symmetric w.r.t. G12, i.e. 
G23, G12 and G24 should be equally spaced. (Once this symmetry is respected, it is very easy for GAP 
to produce the desired structures, even with arbitrary ki and ^3.) 

In sum, our analysis leads to the following presentation: 

G = {a,b,c\aF = hP-^ = = I, a!' = a' , {cbif = b^b^ = I) (11) 

where p is an odd prime, s is a primitive root modulo p, k^ — ki = ki — k^ (mod p). If our extension 
of the subgroup structures succeeds, then the orders of subgroups and intersections would be: |Gi| = 6, 
IG2I = p{p-l), {Gsl = IG4I = 2(p- 1), IG12I = IG13I = IGuI = 2, IG23I = IG24I = P-I, 
IG34I = IG123I = IG124I = 1. LHS of dl = 6p{p - 1) while RHS = 8{p - if. So for p > 5, Ingleton 
should be violated. 
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V. Explicit Violation Construction with PGL{2, q) 

Feeding the above presentation into GAP, we find that for p = 5, 7, . . . , 23 the outcome is a finite 
group, and it violates Ingleton with subgroups in (fTOl ). Moreover, with GAP we verified for the first few 
primes (up to p = 11) that this group is isomorphic to PGL{2,p). In fact, we prove that PGL{2,p) is 
indeed a family of Ingleton-violating groups for primes p > 5, by explicitly constructing their violating 
subgroups. Furthermore, once we have the formats of these subroups, we extend them to the Ingleton- 
violating family PGL{2, q) for all finite field order g > 5. In Appendix |Al in the framework of group 
actions we show that this family of Ingleton violations has a remarkably nice interpretation: each subgroup 
is the stabiUzer for a special set of points in the projective geometry of PGL{2,q). 



A. The Family PGL{2,p) 

Let p be an odd prime. For A G GL{2,p), let A denote the left coset of A in GL{2,p) with respect to 
the center Vp = {al : a G }. Thus A = B if and only if each entry of A is a nonzero constant multiple 
of the corresponding entry of B. A'^ denotes the transpose of A as usual. We denote the elements of ¥p 
by ordinary integers, but the addition and multiplication, as well as equality, are modulo p. Furthermore, 
—k and k^^ denotes the additive and multiplicative inverses of k in ¥p respectively. If s G ¥p, and A has 
multiplicative order p, then A^ simply indicates the s-th power of A, where s is viewed as an integer. 

We start by identifying the generators in PGL(2,p) that correspond to presentation (fTTI ). Consider the 
following matrices in GL{2,p): 

A 

where t is a primitive root modulo p, i.e. a generator of . Our guess is that A, B, C correspond to the 
generators a, 6, c in (fTTI) respectively. The powers of these matrices are: 

G^ = 1 



1 




1 




1 




B = 




c = 




1 1 




t 




-1 -1 



1 





, B^ = 


1 




-1 -1 












k 


1 









1 



A" 

for any integer k. Thus \A\ = p, \B\ = p — 1, and \G\ = 3. Also, 

1 



A 



B 



B-^AB 



-1 



1 



A' 



-irB -rs 



where s = t is also a primitive root modulo p. So ^4 = A . Next we let 



B, 



1 

-ki 1 





1 




1 









-1 




h 


1 





1 

-2k 
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where we calculated t 2 

CBi = 



- 1 as it is the unique element of order 2 in . Now check 



-2ki -1 
2A;i - 1 1 



Akf -2^1 + 1 2ki - 1 
-{2ki - 1)2 2 - 2ki 



Thus if we want (CBi)'^ = I, ki must be 2 ^ = ^±1. in this case, 





1 




-1 -1 


Bi = 










-1 -1 




1 



{CB, 



Let i?3 = '\ i?4 = S^"*. As k^ - ki = ki - k^, we have ^3 = 1 - k^. 



B 



A'' 



1 

k{t - 1) t 



B^C ■ B4 



1 

-t k3{t-l)-t 



1 

ki{t-l) t 



whose (1, l)-entry is /c4(t — 1). If we want {B3)'-^B4 = I, i.e., B3CB4 = C, k^ must be since the 
(1, l)-entry of C is and t ^ 1. So k^ = 1 - k^ = 1, 





1 




1 





B3 = 




, Bi = 








t-1 t 







t 



B, BsCBi 



1 




1 







t 


-t -1 







t 




-t -t 



c. 



So far for A,B,C we have verified all the relations in (fTTI ). We can also prove that they are actually 
a set of generators for PGL{2,p). Observe that each matrix in GL{2,p) can be written as a product of 
some elementary matrices, which are 



1 
a 1 



1 /? 
1 



1 

f 





1 



where a,/3 G Fp and i,j G ICp. They are generated by A,A^,B and t ^B respectively. So PGL{2,p) 
is generated by A, A'^ and B. Now check 



1 

1 



A 



BiC 



1 1 

1 



A' 



thus A,B and C generate PGL{2,p). Hence setting s = t^^, ki = ^ii, ^3 = 1, k^ = 0, we see 
that PGL{2,p) is a quotient of the group G in (ITTI ). in which ^, i? and C correspond precisely to the 
generators a, b and c of G. 

Remark 8: Note that we have not proved that (fTTI ) is a presentation of PGL{2,p). To do that, one must 
show that the order of the group generated by a, b, c in (ITTI ) is no more than \PGL{2,p)\ = {p—l)p{p+l). 
However, identifying possible corresponding generators still gives us a way to explicitly construct the 
subgroups to violate Ingleton. 

Now we can write out the subgroups in PGL{2,p) corresponding to subgroups in dTOb . 



19 



Gi = {C, Bi). Note that \C\ = 3, \Bi\ = 2, and {CBif = I, so CBi = Bi{Cf and d has at most 
6 elements {(i?i)*(C)-' : < i < 2, < j < 3}. Calculating these elements we can see |Gi| = 6 exactly 
and thus indeed Gi = Dq^ S^.: 







1 




-1 -1 




1 




1 




-1 -1 


1 


-1 




-1 -1 




1 


1 


-1 -1 




1 


1 


1 





G2 = {A, B). We claim that G2 is the subgroup of lower triangular matricej^ in GL{2,p) modulo Vp, 



I.e. 



Go 



1 

a 13 

As A, B are lower triangular, any element in G2 is a lower triangular matrix modulo Vp. On the other 
hand, Va G Fp, /? G F^ , /3 = for some integer So 



1 

a (3 



1 

a (3 



A^d G G2. 



Thus IG2I = p(p — 1) and G2 has presentation (|8]|. Therefore G2 = xi Zp_i and achieves the desired 
flower structure. 

= C^iiCf^'Bl) = (CB'x.'Bl). Note that '^B[\ = 2, \B^\ = \B\=p-l, also 



1 







B. 



-1 



1 



S3 • Ci?i 



-1 -1 




l-t 1 





Ci?l(i?3)^\ 



SO G3 has at most 2(p - 1) elements {(GSi)*(^y :0<i<2, 0<i<p-l}. Calculating these 
elements we can see IG3I = 2{p — 1) exactly and so G3 = -D2(p-i)- 



G3 





1 


1 {B,f = 







Gi?i(i33)* 



-1 -1 

1 - r'^ 1 



A: G /Ce 



actually conjugate to each other, e.g. consider 





w 










X y 




z 







1 






where W = 






z 




y ^ 




1 
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Finally, G4 = {BiC,Bi). BiC 



1 

1 



, so l^iCI = 2, 1^41 = \B\=p-l. Also 



-B4 • B\C 



1 




"0 t-l' 


= BiCiB^)-^ 








t 




1 





so G4 has at most 2{p - 1) elements {{BiCy{B4)^ : < i < 2, < j < p - 1}. Calculating these 
elements we can see IG4I = 2{p — 1) exactly and so G4 = -D2(p-i)- 





1 















, i?iC7(i?4)' = 










t'' 




1 





G4 



These are all diagonal and anti-diagonal matrices in GL{2,p) modulo Vp. We have already verified that 
(B^)^ = 'BT^, also (CB{f = B^, thus indeed G4 = Cf. 
With all four subgroups explicitly written, we can easily write down the intersections: 



G12 = {Bi) = { I, 





1 


1 




-1 -1 





Z2, Gi3 = (CBi) 





-1 -1 








1 



Gi4 = {BiC) = { 



1 

1 



^2, ^23 = (-B3) 



1 



G24 = (-B4) 



1 

t'' 



p-l, ^34 — G123 — L^124 



1. 



IG12I = IG13I = [G14I = 2, IG23I = 1^24! = p — I. 

So in ©, indeed = IG1IIG2IIG34IIG123IIG124I =6p{p-l), RHS = IG12IIG13IIG14IIG23IIG2 

8{p — 1)^, LHS — RHS = 2{p — 1)(4 — p). Thus Ingleton is violated when p > 5, and the subgroup 
structures of S5 = PGL{2,5) axe exactly reproduced. 
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B. The Family PGL{2,q) 

With the explicit forms of the Ingleton-violating subgroups, we can extend the above violation to 
PGL{2, q), for each finite field order q > 5. Consider the finite field Fg. We know that q = p^ for some 
prime p (the characteristic of Fg) and some integer m. Since Fp is the prime subfield of Fg, GL(2,p) 
is a subgroup of GL{2,q), which induces a copy of PGL{2,p) as a subgroup of PGL(2,q). Therefore, 
using the same subgroups of PGL{2,p) as in the previous section, we obtain a (trivial) Ingleton violation 
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in PGL{2, q) whenever the characteristic p > 5. Nevertheless, by extending the interpretations of these 
subgroups to PGL{2, q), we can obtain a more general (nontrivial) violation, for each finite field order 
g > 5. 

In the field Fg, we continue to use the ordinary integers with modular arithmetic to represent the 
prime subfield Fp. With this convention, all the matrices and subgroups in Section IV-AI are well definecj^ 
although now the cosets are taken with respect to Vq rather than Vp. These subgroups constitute a 
trivial embedding of our previous violation in PGL{2,q). However, in PGL{2,q), the previous sets of 
generators do not guarantee that G2 is the full subgroup of all lower triangular matrices, nor that G4 
contains all the diagonal and anti-diagonal matrices. 

To address this issue, we redefine t to be a primitive element of Fg, i.e. t generates F^. Then \B\ = 
q — I. Also instead of a single A, we need to introduce more matrices to generate the subgroup N = 
{ I a £ } , where for each a G Fg we define 

A ' 
a 1 

Clearly AaAp = Aa+/s, and A^ = A^a for each integer k. Thus \Aa\ = p for each a G F^ . Observe 
that Fq is an m-dimensional vector space over Fp, let {^1,^2, ■ ■ ■ ,Cm) be a basis. Then Va € Fg, 
a = YaLi hii for some A:2, . . . , fc^ G Fp and A„ = 1 Also n(^) = 1 for distinct i 
and j. Thus 

Actually, is isomorphic to the additive group of the vector space of Fg over Fp (Also see Section lVII-AI) . 

Let G2 = {A^^,A^^, . . . , A^^^^,B) = {N, B). Similar to the previous section, it is easy to show that now 
G2 is indeed the subgroup of all lower triangular matrices modulo Vq. For any a G Fg, we have Aa = 
A^, so N <G2 and G2 = NH, where H = (B). Also Nf]H = 1, thus G2 = iV x ^ x Zg_i. 
Although in general G2 does not have presentation ([7]) or dSjl anymore since N is not necessarily cyclic, 
we can prove that it does have a "generalized flower structure" when q > 2, i.e. {G2 \ N) is the 

union of groups which are all isomoiphic to H with trivial pairwise intersections. Similar to the analysis 
of the G2 in Section |IVl it suffices to show that H^" f]H = 1, ^A^ e N\ {I}. But this is true since 

The only problem that may arise is when p — 2, Bi — (B ) is not well defined. But we can circumvent that by 
directly working with the final matrix form of Bi. 
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for each a € and some integers k,l G ICq, 



b'" ■A^ = A^- B^ 



1 



1 



a f 



= / = 0. 



Fig. |2] shows two representative generalized flower structures of G2, when (7 = 8 and 9. In each 
cycle graph of G2, there are \N\ = q petals and one "root system" (encircled by the dash-dotted line), 
which is the normal subgroup N. Every petal is a conjugate of H and has size q — 1. Since N has 
q — 1 nonidentity elements, each having order p, the root system consists of {q — l)/{p — 1) trivially 
intersecting "roots/tubers", each of which is a p-cycle. Note that if m = 1, then there will be only one 
root/tuber, as in the original flower structure in Fig. [T] 

Now using the same matrices 





1 




1 


c = 










-1 -1 




-1 -1 



B^ = B 



1 

t-l t 



Ba = B 



1 
t 



as in Section rV-AI (except that t now generates instead of F^ ), we write down the following subgroups: 
Gi = {C, Bi) = Dq = 53. (This subgroup is the same as in Section IV-AI ) 



G2 = (Agi ,A^^,... , A^^ , B) = {N, B) = {all lower triangular matrices in PGL{2, q)} 



= {Bi{Cy,B3) = {GBi,Bs). Now IB3I = q - 1, and we stiU have B3 ■ CBi = CBiiB^)-^, so 



23 



Gi = {BiC, Bi). Now IS4I = q-l and BrBiC = BiC{Bi)-^, so G4 = {{BaY, BiC{BiY | A: G /C^ 
= {all diagonal and anti-diagonal matrices in PGL{2,q)} = -D2(g-i)- 

The intersections are: Gu = {Bi), G13 = (CBi), and G14 = (BiG), which are all isomorphic to Z2; 
^23 = (^3) and G24 = (-B4), both of which are isomorphic to and G34 = G123 = ^124 = 1- 

The orders of these subgroups are: = 6, IG2I = q{q — 1), IG3I = IG4I = 2{q — 1). For the 
intersections: 16*12! = l^nl = {Gu] = 2, IG23I = IG24I = q — 1, \Gs4\ = [G123I = IG124I = 1. So in 
dl, LHS = IG1IIG2IIG34IIG123IIG124I = dqiq - 1), RHS = IG12IIG13IIG14IIG23IIG24I = 8iq - 1)2, 
and LHS — RHS = 2{q — 1)(4 — q). Thus using these subgroups in PGL{2, q), Ingleton is violated for 
each finite field order q > 5. 

Remark 9: Depending on the characteristic p of ¥q, the intersection G12 = {Bi) might lie in either 
the petals or the roots of G2, as depicted by the dashed circles in Fig. |2] If p 7^ 2, then q is odd and 
'Bl = (b'^)^"^ where A;i = 2"^ = so G12 is on the petal H^"^ . Whereas if p = 2, then -1 = 1 
and Bi = A = Ai ^ N , G12 becomes a root. Note that the patterns of the other intersections are not 
changed for different g's. 

Remark 10: We can also show that A^^ , A^^ , ■ ■ ■ , A^^ , B and G generate PGL{2, q), using the same 
argument as the previous section. The only difference is that the elementary matrices of GL{2, q) are now 
generated by A^^,Aj^,..., , Aj^^^ , B and t'^B. But as A^^'^ = A^, Va G ¥g, we see that PGL{2, q) 
is indeed generated by the desired elements. 

Remark 11: The subgroups G1-G4 have nice interpretations in the framework of group actions and 
groups of Lie type. Please refer to Appendix |A] for more details. 

C. Generalizations of the Violation Family 

We will generalize the above family of Ingleton violations in PGL{2, q) in two directions. On the one 
hand, PGL{2, q) is the quotient group of GL(2, q), so supposedly GL(2, q) should have a richer choice 
of subgroups and still keep the capability of violating Ingleton inequality. This approach is explored in 
the next section. 

On the other hand, since the subgroups involved in the PGL{2, q) family has nice interpretations in 
terms of group actions, we can generalize this them in this framework. In Appendix |A] we follow this 
method to obtain two new families of violations in PGL{n, q) for general n, and further generalize to an 
abstract construction using 2-transitive groups. Note that with Lemma [3] below, the families PGL{n,q) 
can also be easily extended to families of violations in GL{n,q). 
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VI. More Violations in GL{2, q) 

As PGL{2,q) is the quotient group of GL{2,q) modulo the subgroup Vq of scalar matrices, naturally 
one may ask if general linear groups also violate Ingleton. In fact, the following lemma shows that there 
is at least one set of subgroups in GL{2, q) that violates Ingleton for all finite field orders q > 5: 

Lemma 3: If G is a finite group with normal subgroup N such that H = G/N has a set of Ingleton- 
violating subgroups, then the preimages of these subgroups under the natural homomorphism are sub- 
groups of G that also violate Ingleton. 

Proof: Let {Hi : 1 < i < 4) be a set of Ingleton-violating subgroups in H. Define Gi to be 
the preimage of Hi under the natural homomorphism g ^ gN, then Gi is a group containing for 
each i. By the Lattice Isomorphism Theorem (see e.g. |[T9l ). for any nonempty subset a C {1,2,3,4}, 
Ga/N = Ha, and so \Ga\ = \Ha\ ■ \N\. Thus by checking the orders in {Gi : 1 < i < 4) also violate 
Ingleton. ■ 

Searching with GAP, we find GL{2,5) to be the smallest general linear group that violates Ingleton. 
Up to subscript symmetries and conjugations, it has 15 sets of Ingleton-violating subgroups. We would 
like to analyze their structures, generalize them for g > 5 if possible, and to relate them to the violation 
in the PGL{2, q) case. 

Throughout this section, we always assume g is a finite field order, and p is the characteristic of ¥q. 
We begin our analysis by identifying the preimages of the Ingleton-violating subgroups in the previous 
section under the natural homomorphism vr : GL{2,q) GL{2,q)/Vq = PGL{2,q), according to 
Lemma |3] With no surprise, when q = 5 these are conjugate to one of the 15 violation instances in 
GL{2,5), and they take on easy matrix structures similar to the subgroups in Section [V] From these 
subgroups we further deduce 10 other instances, all of which are essentially variants of the preimage 
subgroups: each instance differs from the preimages at exactly one subgroup (either Gi or G2). These 
11 violation instances can be easily extended to families of Ingleton-violating subgroups in GL{2,q) 
for q > 5, but when p ^ 2 sometimes we need the extra condition that 2^ be even. The remaining 
4 instances cannot be derived directly from the preimages; however, they are interrelated and all their 
subgroups are equal or conjugate to some known subgroups from the previous 1 1 instances. They also 
generaUze to Ingleton-violating families in GL{2,q) with similar conditions as above, plus a limitation 
that p / 3. 

Table U summarizes how the generalization of these instances depends on the values of p and q. We 
can see that when p = 2, these 15 instances collapse to only 6 dinstinct ones; also some instances need 
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(A) Identical Instances whenp = 2 



TABLE I 

(B) The Cases when Ingleton is not Violated 



Instance 
No. 


Identical 
Instance(s) 


1 


5 


2 


3, 4 


6 


8, 10 


7 


9, 11 


12 


13 


14 


15 



Instance No. 


P = 3 


2^ odd 


1-7, 10, 11 






8, 9 




X 


12, 14 


X 




13, 15 


X 


X 



TABLE II 

Orders of Subgroups and Their Intersections 



Ins. No. 


|Gi 


iG2| 


|G3| 


IG34I 


|Gl23| 


|Gl2 


Gl3 


IG23 


LHS - RHS in iHi 





6 


9(9-1) 


2(9-1) 


1 


1 


2 


2 


9-1 


2(?-l)(4-g) 


1 


6(9-1) 


9(9-1)' 


2(9-1)' 


9-1 


9-1 


2(9-1) 


2(9-1) 


(9-1)' 


2(g-l)«(4-g) 


2,4 


6 


9(9-1)' 


2(9-1)' 


9-1 


1 


2 


2 


(9-1)' 


2(g- 1)^(4 -g) 


3 


12 


9(9-1)' 


2(9-1)' 


9-1 


2 


4 


4 


(9-1)' 


16(g-l)='(4-g) 


5 


3(9-1) 


9(9-1)' 


2(9-1)' 


9-1 


1-1 
2 


9-1 


9-1 


(9-1)' 


i(g-l)«(4-g) 


6-9 


6(g-l) 


9(9-1) 


2(9-1)' 


9-1 


1 


2 


2(9-1) 


9-1 


2(g- 1)3(4 -g) 


10,11 


6(9 - 1) 


Ml - 1) 


2(9-1)' 


9-1 


2 


4 


2(9-1) 


2(9-1) 


16(g- 1)3(4 -g) 


12-15 


6 


9(9-1) 


9(9 - 1) 


1 


1 


2 


2 


9-1 


2(g-l)(4-g) 


8',9' 


6(9 - 1) 


9(9-1) 


2(9-1)' 


9-1 


2 


2 


2(9-1) 


9-1 


8(g-l)3(2g + l) 


13', 15' 


6 


9(9-1) 


9(9-1) 


2 


1 


1 


1 


9-1 


2(g-l)(2g + l) 



specific conditions on p and q to violate Ingelton. 

In Table HIl the orders of the subgroups for the cases we have explored in PGL{2,q) and GL{2,q) 
are listed. No. denotes the instance in PGL{2,q), and No. 1-15 denote the generalizations of the 15 
violation instances in GL{2,b) to GL{2,q). Since all instances have the subgroup order symmetries 

, 3| — |u-4[, |(-Ti23l — l'j"124|, I'^lSl — I'^Ul, \^23\ — \'^24:\, 

only one of each pair of orders is listed. Note that when p = 2, there are only 6 such dinstinct 
generalizations, which are Instances 1, 2, 6, 7, 12 and 14. Thus for the order calculation of all other 
instances in GL{2,q) assume p ^ 2. Moreover, No. 8', 9', 13' and 15' correspond to Instances 8, 9, 13 
and 15 when p ^ 2 but is odd, in which case Ingleton is satisfied. Finally, the order calculation for 
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Instances 12-15 only works for p 7^ 3. 

Although in Table JI] we list the difference between the two sides of @ to demonstrate if and when 
Ingleton is violated, it is not the correct quantity to measure the extent of violation for a given entropy 
vector. For that purpose, the difference 

hi+h2 + hu + /il23 + hi24. - {hl2 + hi3 + /li4 + /l23 + /i24) 

for the original inequality Q should be used, which in finite group context equals log of (H]). Thus 
for a 4-tuple of subgroups r = (Gj : 1 < i < 4), we define the "Ingleton ratio" 

, 12||tjl3||'j"14|l(j"23l|'j"24| 



r(T) 



(12) 



, l||L^2||tj34||tjl23||'j"124| 

to measure the extent to which Ingleton is violated. Clearly Ingleton fails iff r > 1. From Table |lll all 
violation instances listed have the same ratio 

4(g - 1) 
3q ' 

which approaches 4/3 when q is large. 

In the following, we present all of these extended violation families, with Section I VI- A I being the 
set of preimage subgroups. Sections IVI-BI and IVI-CI the 10 variants, and Section IVI-DI the remaining 4 
instances. We continue to use the notations from Section |V] with t being a primitive element of F^, but 
we redefine 



•p ■ 



In addition, we introduce the following matrices and subgroups in GL{2, q) to facilitate our presentation: 





-1 




t 







t 


B' = 




P = 






, p' = 






t 







1 




-1 



a G F, 



9' 




1 




-1 -1 




1 







1 




-1 -1 


1 


-1 -1 




1 




-1 -1 




1 







1 






a £ ¥g, 
/c G /Co 



a (-1)'^ 



a G F, 

k e JCn 



I?' 



Note that when p = 2, we have -1 = I, so B' = B, P' = P, and K' = K, J' = J. Also note 
that M and K precisely correspond to the Section |V] groups Gi and G2 respectively. The group M is 
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isomorphic to Dq = S3, while the other four groups are all semidirect products xi Zg-i, with K = J 
and K' = J'. Moreover, K and J have generalized flower structures for all q > 2. However, if p 7^ 2, K' 
and J' only have flower structures when is even, in which case they are also isomorphic to K. (See 
Section IB-AI in Appendices for proofs.) This turns out to be a necessary condition to violate Ingleton in 
all the instances where K' and J' are involved. 



A. Instance 1: The Preimage Subgroups 

To obtain the preimage Hq of a subgroup H < PGL{2, q) under vr, we can generate Hq in GL{2, q) 
with the generators of H (without overlines) and tl, since Vq = {tl) = 

Gi = {tI,C,Bi) = {Vq,M). Since Vg is the center of GL{2,q) and intersects M trivially, Gi is a 
direct product: d = {t^X \ X e M,k e ICg} Vg x M ^ Zg^i x S3. 

G2 = {tl, A^^ , A^^ , • • • , A^^ , B) = {tl, N, B) = {Vg, K). G2 is the subgroups of all lower triangular 
matrices in GL{2, q), and as f] ^ = 1' we have G2 = x ^ Zq_i x (Z™ x Zg-i). 



G3 = {tI,BiC\B3) = {tI,CBi,B3) = {CBi,T), where T = {tI,B3). As Vg^{B3 



1, we 



have T = {t'^B.^' | A:, m € /CJ ^ x {B3 



X 



It is easy to check that {t'^B'^')'^^^ 



^k+m^-m ^ j,^ ^ ^^^^^ . T and T < G3. Furthermore, \CBi\ = 2 and T^{CBi) = 1, thus 

G3 ^ T X {CBi) ^ X >^ Z2 and 





1 




-1 


G3= jt" 




t"^ - 1 




1 -t-"^ 


G4 = {tI,BiC,Bi) = {tI,BiC,B) = {BiC,D), where D = 



1 



D = {t^B"^ I /t, m € /Cg} = {aU diagonal matrices in GL[2, q)} ^VgX {B) ^ x Note that 

so G4 = (AC) • L> and Z) < G4. Since |5iC| = 2 and D{^{BiC) = 1, G4 ^ x (BiC) ^ 
X X Z2. Actually G4 is the subgroups of all diagonal and anti-diagonal matrices in GL{2, q): 











a 







/3 





/5_ 




a 



Ga 



a 
/3 



/? 
a 



Calculating the intersections, we have G12 = {tl, Bi) = VgX {Bi), G13 = {tl, CBi) = VgX {CBi) 
and Gi4 = {tl, BiC) ^ Vg x {BiC), all of which are isomorphic to Zg_i x Z2. Also, G23 = T, G24 = D 



and G; 
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123 



Gl24 = (t/> = Vg. 



From the calculation in Table HIl Ingleton is violated when q > 5. 
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TABLE III 

Gi FOR Instances 2-5 



Ins. No. 


2 


3 


4 


5 


Gi 


(G,Bi) 


(-G,Bi> 


(G, -Bi} 


(G,tBi) 



B. Instances 2—5: Variants with Different Gi 's 

In all the instances in this section, only Gi is different from Section IVI-Ai it is now a proper subgroup 
of {tI,C,Bi) (see Table Hill where the generator-form for these groups is used to better demonstrate 
the subgroup relations). When p ^ 2, these instances are all distinct; however, when p = 2, clearly 
Instances 3 and 4 collapse to Instance 2, while Instance 5 becomes Instance 1. From Table HIl we can 
see that they all violate Ingle ton when q > 5. 

1) Instance 2: Gi = M. 

Gi2 = {Bi), Gi3 = {CBi) and Gu = {BiG) are all isomorphic to Z2, and G123 = G124 = 1. 

2) Instance 3: Gi = {—G,Bi). 

We only consider the case p ^ 2, since otherwise this is the same as Instance 2. As |C| = 3, we have 

{-Gf = -I and (-C)^ = C. Thus Gi = {-I,G,Bi) = {-I,M) ^ (-/) x M ^ Z2 x S3 = D12, 
since (— /) is a subgroup of Vg and intersects M trivially. So Gi = {±X | X € M}. 

Now, G12 = {-I,Bi) ^ (-/) X (Bi), Gi3 = {-I,CBi) ^ (-/) x (GBi) and Gu = {-I,BiC) ^ 
{—I) X {BiC), all of which are isomorphic to Z2 x Z2. Furthermore, ^123 = G124 = {—I) — ^2- 

3) Instance 4: Gi = {C, -Bi). 

Here we also need only consider the case p ^ 2. Observe that \G\ = 3, |--Bi| = 2 and (C • (— = 
{CBif = I. This gives us Gi = {l,G,G^ , -Bi, -BiC, -GBi}, so Gi^Dq^ S3. 

For the intersections, we have G12 = {—Bi), G13 = {—CBi) and G14 = {—BiC) all isomorphic to 
Z2, and G123 = G124 = 1- 

4) Instance 5: Gi = {C,tBi). 

When p = 2, g is even. Since |-Bi| = 2 and \t\ = q - 1, we have (tBi)'' = tl and {tBi)i-^ = Bi. 
Thus Gi = {tl, G, Bi) and this instance is the same as the preimage subgroups. 

So assume p / 2. Here q is odd, so \tBi \ = q — 1. When k is even, {tBi)'^ = t'^I and so C^^^^^'' = G. 
Otherwise (t^i)^ = t^^Bi, then C^^^''^' = BiGBi = G'^ since {CBif = I. So Gi = {tBi) • (C) 
and (C) < Gi. Furthermore, {tBi) C\{G) = 1 and |G| = 3, thus Gi ^ (G) x (t^i) ^ Z3 x and 
Gi = {t'^I, t^'C, t^C^ \k£lCg and is even} U {t'^Bi, t^BiC, t^GBi \ k e JCg and is odd}. 
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TABLE IV 

G2 FOR Instances 6-1 1 



Ins. No. 


6 


7 


8 


9 


10 


11 


G2 


{N,B) 


(iV,P) 


{N,B') 


{N, P') 


(-/,iV, B) 





The intersections are: G12 = {tBi), G13 = (tCBi) and G14 = {tB\C) are all isomorphic to Zq_i, 

and G123 = ^124 = {t^I) = Z^. 

2 

C. Instances 6-11: Variants with Different G2's 

In all the instances in this section, only G2 is different from Section IVI-A[ it is now a proper subgroup 
of {tl, N, B) (see Table HVl ). It is easy to see that these instances are distinct when p / 2; otherwise 
Instances 8 and 10 collapse to Instance 6, while Instances 9 and 11 become Instance 7. Thus in the 
analysis of Instances 8-11, we assume p ^ 2. From Table HIl Instances 6, 7, 10, 11 violate Ingleton 
whenever (7 > 5; however, if p / 2, Instances 8 and 9 only violate Ingleton when in addition is even. 
Please refer to Section IB-BI in Appendices for the calculation of subgroup intersections in Instances 8 
and 9. 

1) Instance 6: G2 = K. 

In this case, G12 = {Bi) ^ Z2 and G123 = G124 = 1- Also, G23 = (-B3) and G24 = (B), both of 
which are isomorphic to 

2) Instance 7: G2 = J- 

Now, G12 = {-Bi) ^ Z2 and G123 = ^124 = 1. Here, G23 = (t"^53) and G24 = (P), both 
isomorphic to 

3) Instance 8: G2 = K'. 

(Bi) ^ Z2 if ^ is even f 1 if ^ is even 

G12 = { , G123 = G124 = \ 

(-/) = Z2 otherwise I (-/) = Z2 otherwise 



9+1 



In this case, G23 = (—^3^ ) and G24 = {B') are both isomorphic to 
4) Instance 9: G2 = J'. 

f {-Bi) ^ Z2 if 2^ is even f 1 if 2zl is even 

G12 = < , G123 = G124 = \ 

[ (-/) ^ Z2 otherwise [ (-/) ^ Z2 otherwise 

q-3 

Here, G23 = {tB^'^ ) and G24 = {P') are isomorphic to Zg_i. 



30 



TABLE V 

Subgroups for Instances 12-15 



Ins. No. 


Gi 


G2 


G3 


Gi 


12 


M 


{N,B) 


(iV,P>^ 


{N, P)'^ 


13 


M 


{N,B'} 


{N, FY 


(N, P')« 


14 


M 


{N,P)^ 


{N,B) 


{N,B)'^' 


15 


M 


{N, py 


{N,B') 


{N,B')'^ 



5) Instance 10: G2 = {-I,N,B). 

Now we have G2 = {-I,K) ^ (-/) x K ^ Z2 x {Z^ xi since {-I)f]K = 1. Thus 

G2 = {±X\X G K}. 

For the intersections, we have G12 = {—I,Bi) = x Z2 and G123 = 6*124 = {—I) — ^2- Also, 
G23 = (-1,33) ^ (-/) X {B3) and G24 = {-I,B) ^ (-/) x (B), both of which are isomorphic to 

Z2 X Zq_i. 

6) Instance 11: G2 = {-I,N,P). 

Here G2 = {-I, J) = {-!) x J Z2 x {Z^' x Z^^i), since (-/) fl -^'^ = 1- Thus G2 = {±X \X £ J}. 
Moreover, Gu = {-I,-Bi) = {-I,Bi) ^ Z2 x Z2 and G123 = G124 = (-/) = ^2- Also, 
G23 = (-/,t^^S3) ^ (-/) X (t-'^Bs) and G24 = {-I,P) = {-!) x (P) are both isomorphic to 

Z2 X 



D. Instances 12—15 

For these last four instances, Gi is always M, G2-G4 are equal or conjugate to one of K, K' , J, J', as 
listed in Table jV] Thus G2-G4 are all semidirect products x Zq_i, and the structures of G3 and G4 
are different from all previous instances. The conjugators E, Q, W and the elements of new subgroups 
are as follows. 





-1 1 






2 1 






1 


E = 






= 




W = 






1 






1 






-1 1 










1 - 


- V 


V 




n G F? . 1 


J^ = 


(iV,P) 


























1 — u — V 


U + V 




gf, J 



(j')^ = (iV,P') 



a 



a 



-iV-P-a P + a 
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l + 2y y 
2{x - 2y - 1) x-2y 




(-1)^ + 2/3 
2 (e -2(3- {-ly 



f -2/3 



/3 eF 
i G /Co 



{N,B) 



w 



X y 
1 



{N,B') 



i\W 



/3€F 



9' 




(-1)* i G Ka 

As mentioned before, Instances 12-15 do not violate Ingleton when p = 3. In this case, we have 
2 = —1, so E = Q and M < J^. Thus in Instance 12 we have G3 = G4 and Gi < G3, while in 
Instances 13 and 14 we have G3 = G4 and Gi < G2 respectively. So these three instances satisfy 
Conditions [5] and/or |7] Instance 15, however, satisfies Condition [3] in this case (see Section IB-CI in 
Appendices). 

Besides p 7^ 3, we also need p 7^ 2 to make Instances 13 and 15 distinct violations: otherwise they 
collapse to Instances 12 and 14 respectively. Thus in the rest of this section, we always assume p ^ 3, 
while for Instances 13 and 15 we assume p > 3. From Table JIJ Instances 12 and 14 violate Ingleton 
when q > 5 (and of course, p ^ 3), while if p 7^ 2, Instances 13 and 15 only violate Ingleton when in 
addition 2^ is even. Please refer to Section IB-DI in Appendices for the intersection calculations. 

1) Instance 12: G2 = K,G3 = J^, G4 = J^. 
We have Gu = {Bi), G13 = (BiG) and Gu 

Gi2i = 1- Furthermore, 

1 
1 - 

both are isomorphic to 'Lq-i. 

2) Instance 13: G2 = K'^G^ = {J')^,Gi = (J') 

When is even, G12, 6*13,^14 and G34 are the same as in Instance 12. Otherwise G12 = G 



{CBi) all isomorphic to Z2, and G34 = G123 



G 



23 



(P)^, G 



24 



1 

2{f - 1) f 



i £ /Co 



Q 



13 



Gi4 = 1 and G34 = (-/) = 

{-ly 
-ly-p p 

are both isomorphic to 



G 



23 



'2- ^123 and G124 are always trivial. Also, 

(-1)^ 



i\E 



G^ 



24 



2 [f - {-ly) f 



i G /C„ 
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24 



w 



-•q—l- 



3) Instance 14: ^2 = 7^,^3 = Gi = K^. 

Observe that G2 and G3 are obtained from swapping the corresponding subgroups from Instance 12. 
Therefore G12 and G13 are also swapped while G23 remains the same. It turns out that Gi4,G34,Gi23 
and Gi2i are also the same as in Instance 12. Furthermore, 

1 - 
1 

4) Instance 15: G2 = {J')^,G^ = K',G^ = {K')^ . 

In this case, G2 and G3 from Instance 13 are swapped to yield the corresponding subgroups here. So 
G12 and G13 are also swapped while G23 stays the same. Moreover, ^14,^34,^123 and G124 are the 
same as in Instance 13, both when 2^ is even and otherwise. Finally, 

f {-ly-f 



G- 



24 







-11 



{B') 



q-l- 



VII. Group Network Codes Using the (Projective) General Linear Groups 

We can use our Ingleton-violating groups to construct group network codes. From Section II-CI the 
resulting entropy vectors are characterizable by the subgroups used, thus have the capability of violating 
the Ingleton ineqality. In contrast, the entropy vectors of hnear network codes always respect the Ingleton 
inequality. Furthermore, let G be any of PGL{n,p), PGL{n, q), GL{n,p) or GL{n, q). In the following, 
we will show that linear network codes can be embedded in the group network codes using direct products 
of copies of G. Apparently a direct product of any copies of an Ingleton-violating group still violates 
Ingleton, thus such classes of group network codes are strictly more powerful than linear network codes. 

To construct a group network code, the choices of subgroups are not arbitrary: they should meet 
requirements (R1)-(R3). In particular, (Rl) limits what subgroups can be associated with the sources: 
we need to satisfy 

\{\G,\ = \Gf\-^\Gs\. (13) 

s&S 

When this is the case, we simply say the subgroups {Gg : s G 5} are independent. We will study the 
constructions of independent source subgroups in the context of PGL{2, q) and GL(2, q) (since they have 
simpler structures than general PGL{n,q) and GL{n,q)), and also provide a universal source subgroup 
construction for direct products of groups. 
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A. Embeddings of Linear Network Codes 

As remarked in Section IT^ linear- network codes are a special type of group network codes. Consider 
a linear network code C over a finite field F. For each t ^ S\J8, the alphabet yt is a finite dimensional 
vector space over F. Let v denote the concatenation of all the source vectors {Yg : s G 5), then v is 
a vector in y = ©se5 Ug, where Ug = O^s- Then for each edge e, the global mapping (^e is a linear 
transformation from V to y^, whose range is denoted by Ue- Also for each source s, let be the linear 
transformation that maps v to its part from s, which we call the s-th section. Thus Vt G 5 U f , we 
can write Yt = ^t{v)- Let Wt be the null space of Lpt, then by the First Isomorphism Theorem, 

iitw + Wt^ (pt{v) 

is a vector space isomorphism between the quotient space V/Wt and Ut- 

Let t be an edge or a sink node. If Y/- = for all / € 'F{t), then = as the encoding/decoding 
functions are linear. Thus nfeJ(t) ^/ — Further, for each source s 

Wg = {v \ s-th section of v is 0} = ©re<s\{s} ^r, 

so HsGS^s = 0. Since V/Wg ^ ^7^, we have IIsgsI^/^sI = 1^1- Let G = V, Gt = Wt for all 
t G 5 U then it is straightforward to check that the requirements (R1)-(R3) are all satisfied, so we can 
define a group network code C with these groups. 

This network code is equivalent to C, since {ipt : t ^ S VJ £} provides a set of bijections between 
their codewords at each source/edge, and these bijections respect the encoding/decoding operations. 
In particular, assume in C the source vectors yield some v £ V. Then Yt = (pt{v) is transmitted at 
each source/edge t, and with tpt the corresponding symbol for C' is v + Wjj. So by Proposition [T] the 
encoding/decoding result of C at each edge/sink node is consistent with C. 

For example. Fig |3] demonstrates a linear network code over Fg for the well-known butterfly network 
(Fig. [3]-(a)), and the corresponding group network code (Fig. |3]-(b),(c)). Here, for the linear network code, 
we have V = F^, Ui = U2 = Ue,, = ¥g, while Wi = {(0, x) : x e FJ, W2 = {{y, 0) : y G FJ, and 
We,, = {{z, -z) : z G ¥g}. If we set G = V, Gi = Wi, G2 = W2, and G3 = We,,, then the resulting 
group network code is equivalent to the original linear one. 

From the discussion above, we observe that linear network codes are determined by the underlying 
additive group structure. The direct sum V can be called the ambient vector space of the linear network 



^Note that cosets are written additively for vector spaces. 
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Fig. 3. Two network codes on the the butterfly network, (a) A linear network code; (b) the subgroup assignment for the 
corresponding group network code; (c) the transmitted symbols in the group network code. In (b), G = {(a, 6) : a,b £ Fq}, 
Gi = {(0,a;) : x € FJ, Ga = {(2/,0) : y € FJ, and G3 = {{z,-z) : z € FJ. In (c), Yi = {{a,x) : x € FJ, 
>2 = {{y, b):y€ FJ, and Y3 = {{a + z,b - z) : z € FJ. 



code. Let {V, +) denote the additive group of V. If we can find a finite group G such that {V, +) < G, 
then the hnear network code is said to be embedded in the group network codes using G, since we can 
use subgroups of G to construct an equivalent group network code. 

Consider a linear network code with ambient vector space V = ¥g for some n and q, where q = 
for some prime p and some integer m. Observing that is an m-dimensional vector space over ¥p, we 
can establish the following facts: 

1) {¥p,+)^Zp, 

2) {Fg,+)^{¥p,+r^Z^, 

3) (F, +) ^ (F^, +f ^ Z^". 

Thus it is fairly easy to see that {V, +) is embedded in the direct product of m • n copies of a group G, 
provided that G contains an element of order p. (By Cauchy's theorem, this is equivalent to p divides 
From this fact, we deduce that linear network codes over Fg are embedded in the group network 
codes using direct products of copies of G™. In particular, let G be any of the linear groups PGL{2,p), 
PGL{2,q), GL{2,p) or GL{2,q). We have the following embeddings in these groups, using properties 
of the matrix A and the subgroup N: 

1) In PGL(2,p), \A\ =p. So ^ (A)"*" < PGL(2,p)"*". 

2) In GL{2,p), \A\ = p. So ^ (yl)"^" < GL(2,p)"*". 

3) In PGL{2,q), = { | a G Fj ^ Z^. So (F, +) ^ AT" < PGL(2,g)". 
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4) In GL{2,q), N = {A^\ a £ F^} ^ Z^. So (F, +) ^ iV" < GL{2,q)''. 

Therefore, linear network codes over ¥q are embedded in the group network codes using direct products 
of copies of G. 

It is straightforward to extend these embedding results for the above linear groups from degree 2 to 
degree n, since the former are subgroups of the latter. For example, GL{2, q) is a subgroup of GL{n, q). 

B. Independent Sources Requirement 

If we want to utilize the Ingleton-violating groups PGL{2, q) and GL{2, q) to construct network codes, 
we need to find their independent subgroups. GAP searching shows that up to conjugation, PGL{2, 5) 
has 16 independent pairs of subgroups, 1 triple and no quadruple. For GL{2, 5), the numbers are 86, 14 
and 0, respectively. It might be desirable to use some of the Ingleton-violating subgroups as sources, but 
we find no independent pairs in any violation instance in either PGL{2,5) or GL{2,5). Furthermore, 
we have the following negative results: 

Lemma 4: Let i,j € {1,2,3,4} and 7^ (3,4). For four random variables Xi, X2, and X4, if 
Xi and Xj are independent, then the Ingelton inequality ^ is satisfied. 

Proof: By symmetry of ([3]l, we only need to prove the result for when = (1,2) or (1,3). In 
the first case, /112 = /ii + /i2, so 

hi2 + hi3 + hi4 + /i23 + /i24 > hi + h2 + + /1123 + h4 + hi2A 

>hi + h2 + /l34 + /il23 + ^124, 

where we used /113 + /i23 > ^3 + /1123 and /114 + /124 > /i4 + /ii24 by submodularity of entropy. The 
second case is similar. ■ 
Corollary 1: There is no independent triple or quadruple in a set of four subgroups that violates 
On another note, if we want to use the Ingleton-violating subgroups in the network. Proposition |2] tells 
us that their intersection should contain the intersection of the source subgroups. Since, in PGL{2, q), the 
intersection of the Ingleton-violating subgroups is trivial, we need to find trivially intersecting independent 
subgroups to serve as sources. In PGL{2, 5), there are 4 such pairs and no such triples. At least one of 
these pairs also extends to most general PGL{2,q): 



Proposition 4: Let U 



G PGL{2,q), and let H be the image of SL{2,q) in PGL{2, 



-1 
t 

under the natural homomorphism, which is isomorphic to PSL(2,q). When p / 2, if and {U) are 
independent in PGL{2,q) with trivial intersection. 
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Proof: It is easy to see \U\ = 2, det U = t. The determinant of any matrix representing an element 
in H takes the form t'^'' G (t^), for some k. But t ^ (t^) as g - 1 is even, so H f]{U) = I. Also 
\(U)\-\H\=2- \SL{2,q)\/2 = \SL{2,q)\ = \PGL{2,q)\, thus ^ holds. ■ 

In GL{2, q) there are more Ingleton-violating instances, which have various intersections. So the 
requirement on the sources is not so strict and we have a richer class of subgroups to work with. 
As in PGL{2,q), there exist trivially intersecting independent pairs, for example: 

Proposition 5: In GL{2,q), SL(2,q) and {B) (or (P)) are independent with trivial intersection. 
Proof: Obviously det B'^ = 1 iff B^ = I, so SL{2, q) and {B) have trivial intersection. Also 
\B\ ■ \SL{2,q)\ = (q-l)- \GL{2,q)\/{q - 1) = \GL{2,q)\, thus ^ is satisfied. The proof for (P) is 
similar. ■ 

Generally it is not easy to find many independent subgroups in a group. If the group is a direct product 
of n of its subgroups, however, it admits a natural construction of n independent subgroups: 

Proposition 6.- If G = Gi x G2 x • • • x G„, then 1 x G2 x • • • x G„, Gi x 1 x • • • x G„, . . . , and 
Gi X G2 X • • • X 1 are n trivially intersecting independent subgroups in G. 

Proof: Trivial intersection is obvious, and it is easy to check that both sides of (fT3] ) are equal to 

This construction is the generalization of the source construction for linear network codes, in which 
case the subgroup at source s is the Ws defined in Section IVII-AI Also we see that using direct products 
we can obtain independent subgroups for an arbitrary number of sources. 

If we further require the sources to be of the same alphabet size, then the independent subgroups must 
have the same order. In the above proposition, this can be achieved by choosing a single subgroup H, 
and setting Gi = H for each i. Additionally, for an arbitrary pair of independent subgroups, we can 
achieve this requirement in the manner described by the following proposition. 

Proposition 7: If Gg and Gr are independent in G, then Gg x Gr and Gr x Gs are independent in G^ 
with the same order. 

Proof: Since Gg and Gr are independent in G, |Gs||Gr| = IGUGsH^'rl- The LHS and RHS of 
([T3I) are |Gsp|Grp and |Gp|Gs Pl^^r-P respectively, which are equal. ■ 

VIII. Conclusion 

Using a refined search we found the smallest group to violate the Ingleton inequality to be the 120 
element group 55. Investigating the detailed structure of the subgroups allowed us to determine that 
this is an instance of the Ingleton-violating family of groups PGL{2,p) for primes p > 5. We have 
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begun investigating PGL{2,p'^) groups and conjecture that they violate Ingleton for large enough p 
and q. Computer search verifies that PGL(2,2^) does not violate Ingleton, whereas PGL{2,2^) and 
PGL{2, 3^) do. Finally, investigating the use of these groups to construct network codes more powerful 
than linear ones may be a fruitful direction for future work. 

Appendix A 

Interpretation and Generalizations of Violation in PGL{2, q) using Theory of Group 

Actions 

Instead of invertible matrices, we can also regard a general linear group as the group of all invertible 
linear transformations on a vector space. In this appendix, we take this point of view and consider the 
actions of linear groups on their corresponding projective geometries. Such actions induce a permutation 
representation for each general linear group on its projective geometry, and the projective Unear groups 
are naturally defined in this framework. Using the theory of group actions, we show that the Ingleton 
violation in PGL{2,q) from Section IVl has a nice interpretation: each subgroup is some sort of stabilizer 
for a set of points in the projective geometry. Furthermore, based on this understanding, we generalize 
the construction in PGL{2, q) to two new families of Ingleton violations in PGL{n, q) for a general n. 
Also we provide an abstract construction in 2-transitive groups generalizing these ideas. 

Throughout this appendix we assume basic knowledge in the theory of group actions, which can be 
found in standard group theory textbooks. In particular, we make extensive use of the orbit-stabilizer 
theorem (see e.g. [19, Sec. 4.1, Prop. 2]), especially when calculating the order of a subgroup. Most 
notations are standard abstract algebra notations, see e.g. fl9\ : the rest are introduced when they first 
appear. 

This appendix is mostly based on Prof. M. Aschbacher's correspondences with us. We have expanded 
on certain details for clarity. 

A. Preliminaries for Linear Groups 

Let V be an n-dimensional vector space over a field F. Recall GL{V) and SL{V) are the general 
linear group and special linear group on V , respectively. They are examples of groups of Lie type, a 
notion which is not totally well defined. 

Each group G of Lie type possesses a building, a simplicial complex on which G is represented as a 
group of automorphisms. Recall a (abstract) simplicial complex consists of a set X of vertices together 
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M(a, b, c, d) 



with a set of nonempty subsets of X called simplices; the only axiom says that each nonempty subset 
of a simplex is a simplex. 

Example A.l: Let X be a partially ordered set. The order complex of X is the simplicial complex 
with vertex set X and with the simplices the nonempty chains in the poset. 

Example A.l: The projective geometry PG{V) of V is the poset of nonzero proper subspaces of V, 
partially ordered by inclusion. The building of GL(y) and SL{V) is the order complex of this poset. 
Of course GL{y) permutes the subspaces of V, supplying a representation of GL(y) on PGiV) whose 
kernel is the subgroup of scalar maps. The images of GL{y) and SL{y) in Aut{PG{y)) are the 
projective general linear group PGL{V) and projective special linear group PSL{V). Write GL{n, F), 
SL{n, F), PGL{n, F), PSL{n, F) for the corresponding group when dim(y) = n and the field is F. 

Example A.3: Specialize to the case n = 2. Then PG{V) consists of the points of V; i.e. the 1- 
dimensional subspaces of V. This is the so-called projective line. Let X = {xi,X2} be a basis of V. We 
regard the projective line as 17 = FU {oo}, where oo denotes Fxi and for e G F, e denotes F{exi+X2). 
Then given an invertible matrix 

a b 
c d 

in GLiy), one can check that, subject to the identification of PGiV) with Q., M{a, b, c, d) acts on $7 
via 

,1^/7 A ax + b 
M (a, 0,0, a) : x -, 

cx + d 

where arithmetic involving oo is suitably interpreted; e.g. (aoo + 6) /(coo + d) = a/c if Cy^O and 
oo if c = 0. So we can regard PGL{V) = PGL{2,F) as the group of these projective linear maps 
M{a, b, c, d), ad — be ^0 on the projective fine il. 
The following result is well known and easy to prove: 

Lemma A.1: PGL(2,F) is sharply 3-transitive on the projective line PG{V). That is, PGL{V) is 
transitive on ordered 3-tuples of distinct points, and only the identity fixes three points. 
Next we introduce several types of subgroups for these linear groups. 

A Borel subgroup of a group G of Lie type is the stabilizer of a maximal simplex in its building. 

Example A.4: A maximal simplex in PG{V) is a flag t = {0 < Vi < ■ ■ ■ < Vn-i < V), where 
dim(Vfe) = k. If we pick a basis X = {xi, ...,Xn} for V such that Vk = {xi : 1 < i < k), then the 
Borel subgroup stabilizing r is the subgroup whose matrices with respect to X are the upper triangular 
invertible matrices. 
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Let G = PGL{2, F). By definition, the stabilizers Gpxi = Goo and Gfx2 = Gq are both Borel 
subgroups of G. The matrices of these subgroups are upper triangular and lower triangular respectively. 
As G is transitive on O, for each of w = cx), we have the bijection gGu '-^ g{u) of the coset space 
G/Gu with 0. 

Buildings have certain special subcomplexes called apartments. For a group G of Lie type, the pointwise 
stabilizer of an apartment is called a Cartan subgroup of G. 

Example A.5: In the projective geometry, the apartments are of the form Ti{X) for X = {xi, • • • , x„} 
a basis for V, where T,{X) consists of the subspaces spanned by nonempty proper subsets of X. The 
matrices in the Cartan subgroup stabilizing are the diagonal matrices. 

Suppose n = 2. Then T,{X) = {Fxi, FX2} = {cxd,0} is just a pair of points. The global stabilizer 
G{u, v) of a pair of points is the subgroup of G permuting the 2-subset {n, v}. In G = PGL{2, F) it 
is (usually) the normalizer of the Cartan subgroup and dihedral. As G is 2-transitivqj on $7, the map 
gG{0,oo) ^ {g{0), g{oo)} is a bijection of the coset space G/G(0, 00) with the set Q2 of 2-subsets of 
il. Further Go n G(0, 00) = Go,oo is a Cartan subgroup isomorphic to the multiplicative group F^ of F. 

Let G be GL{V) or PGL{V) in the rest of this section. 

An element of GL(y) is unipotent if all its eigenvalues are 1. A subgroup of GL{V) is unipotent if all 
its elements are unipotent. The unipotent radical Q{H) of a subgroup H of GL{V) is the largest normal 
unipotent subgroup of H. For example if F is finite of characteristic p, then Q{H) is the largest normal 
p-subgroup of H. Passing to images in PGL{V), we have the corresponding notions in that group also. 

A subgroup of G is a parabolic if H is the stabilizer of a simplex in the projective geometry 
PG{V). Thus for example Borel subgroups are parabolics, and indeed the parabolics are the overgroups 
of the Borel subgroups. 

For each parabolic H, H = Q{H)L{H), where L{H) is a complement to Q{H) in H called a Levi 
factor of H. Thus H ^ Q{H) x L{H). 

Example A.6: Let F = Fg, U an m-dimensional subspace of V with < m < n, G = GL{V), 
and H = Ng{U) the (global) stabilizer of U in G. As {U} is a simplex in PG{V), H is a. parabolic. 
For a subspace/quotient space X of V, let Gh{X) denote its centralizer in H, namely the element- wise 
stabilizer of X. Then Q{H) = Gh{U) n Ch{V/U) is of order pick a complement W to U 

in V. L{H) = Li X L2 where Li = GL{m, q) centralizes W and acts faithfully as GL{U) on U, and 
L2 = GL{n — m, q) centralizes U and acts faithfully as GL{W) on W. Let Xi and X2 be bases for U 



*Note that k-transitivity implies l-transitivity for all / < k. 
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and W respectively, then the matrices of Q{H), Li and L2 with respect to Xi U X2 have the forms 



/ 


K 




Ki 







/ 













and 









I 







/ 







K2_ 



respectively, where the upper-left block of each matrix above has dimension m x m, with Ki and K2 
invertible. Thus \H\ = \Q{H) \ ■ \L{H) \ = g„M^M„_m, where g„ = g"{"-i)/2 and for 1 < A; < n, 

k 

Mk = J{{q' - 1). 

Note \GL{k,q)\ = qkMk- In PGL{V) the image of H has order qnMmMn-m/{q - 1)- 

B. Interpretation of the Ingleton Violation in PGL{2,q) 

Let F = ¥g and G = PGL{2,q) = PGL{2,¥g). In the Ingleton violation construction in Section |V] 
we have a 4-tuple of subgroups p = {Gi : 1 < i < 4) of G. The group G2 = Gfx2 = Gq is a Borel 
subgroup. The subgroups G3 and G4 are isomorphic to the dihedral group 1)2(9-1) of order 2{q — 1), 
and their intersection G2i with G2 is cyclic of order q — 1 and with G34 of order 1. This forces G2i, 
i = 3,4, to be distinct Cartan subgroups of G2, and hence Gi = G(0, ej) for some G F. In fact from 
the forms of the matrices in G3 and G4 it is easy to check that 63 = —1 and 64 = 00. 

Finally Gi = S3 with Gu the three subgroups of Gi of order 2 for 2 < i < 4. For 2 < i < 4 let 
Gu = {ti), and for 1 < j < 4 let Aj be the orbit of Gj on Q containing 0. Then |Aj| = \Gj : G2j\ = nj 
where = = 2 and ni = 3. Indeed Aj = {0, tj(0)} for i = 3,4, with A3 = {0,-1} and 
A4 = {0,00}. Then as Gi = (t3,t4) and ni = 3, A = Ai = {0,-1, 00}. But as G is sharply 3- 
transitive, the global stabilizer G(A) is isomorphic to S3. Hence Gi = G(A), and is determined by G2, 
G3, and G4. Again by 3 -transitivity of G, the map gGi 1-^ 5'(A) is a bijection of G/Gi with the set $^3 
of 3-subsets of Q. 

Hence the 4-tuple p is determined by the ordered triple (0,-1, 00) with the four subgroups being 
various (global) stabilizers on it. Furthermore, given an arbitrary ordered triple (q,/3,7) of distinct points 
in Q,, we can construct a 4-tuple p' in the same fashion, where G2 = Ga, G3 = G{a, (3), G4 = G(a, 7), 
and Gi = G(a,/3,7). Since G is 3-transitive on 0, by the same element in G all four subgroups in p' 
are conjugate to their counterparts in p. In particular, the new tuple p' also violates Ingleton. From the 
observation above we can generalize the Ingleton violation p to a broader class of groups, as described 
in Section lA^ 

With respect to the "flower structure" of G2 = Gq, this follows from the fact that Gq is a Frobenius 
group on il' = 17 — {0}. That is, Gq is a transitive permutation group on $7' in which the maximum 
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number of fixed points of a nonidentity element is 1. (This is guaranteed by the sharp 3 -transitivity of 
G.) Then by a theorem of Frobenius, the identity 1 of Go, together with the set of elements with no fixed 
points, forms a normal subgroup K called the Frobenius kernel of the Frobenius group. In our case, K 
is the subgroup N in Sections |IV] and |Vl which is the unipotent radical of the Borel subgroup Go and is 
isomorphic to the additive group of the field F. Also Go — -f^ is partitioned by the sets Go,a — {1}; o G 
these are the petals in the flower. The subgroups Go,a are the q Cartan subgroups contained in Go, and 
each is isomorphic to F^. 

C. Generalizations in PGL{n, q) 

Let r = (Gj : 1 < i < 4) be a family of subgroups of a finite group G. The Ingleton inequality dJ]) 
fails iff 

IG13G23IIG14G24I 



GiGal < 



1^34! 

In all constructions we will consider in this appendix, Gj = GiiG2i for z = 3, 4 and IG3I = IG4I. Also 
\GiG2 \ = |Gi : G12IIG2I. Hence in such constructions Ingleton fails iff 

|Gi :Gi2||G2| < (*) 

and the Ingleton ratio (fT2l ) becomes 

1^312 



r(r) 



|Gi : G12IIG2IIG34I 

Now we explore three different approaches trying to extend the PGL{2, q) family of violations p to 

PGL{n,q). 

Example A.7: Let G = PGL{n,q) with n > 3. It is easy to see that G is doubly transitive on the 
points of PG{V) and transitive on triples of independent points. Let Pi, 2 < i < 4, be independent points 
in V, A, = {P2,Pi} for i = 3,4, and A = {P2,P3,P4}. Set G2 = Ng{P2), G, = Ng{A,), i = 3,4, 
and Gi = Ng{A). Let t = : 1 < « < 4). 

Now G2 is a parabolic and by Example IA.6I 

\G2\=qnMn-l. (14) 

Next D = P2 + Ps + P4 is a. 3-dimensional subspace of V, so by Example IA.6I again, \Ng{D)\ = 

qnM3Mn-3/{q — 1). Further as Gi acts as the symmetric group on A of order 3, through calculation of 

the preimages in GL{n,q) we have iNdD) : Gi| = \GL{3,q)\/{6{q - if) = q^M2,/{Q{q - if). So 

\NG{D)\-Q{q-lf QqnMn-z{q-lf 
1^^' = JM, = • 
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As Gi is transitive on A of order 3, |Gi : G12I = 3. Therefore 

|Gi : G12IIG2I = 3IG2I = 35„M„_i. (16) 

Also for i = 3, 4, d and Gu are both transitive on A; of order 2, so \Gi : G2i \ = \Gii : Gi2i \ = 2. Thus 
\GiiG2i\ = \Gii : Gi2i||G'2jl = l^il and Gi = GiiG2i for i = 3,4. Since G is doubly transitive on the 
points, G3 is conjugate to G4 and so IG3I = jG4|. Further U = P2 + ^3 is a 2-dimensional subspace of 
V, so by ExamplelASl \Ng{U)\ = qnM2Mn-2/{q-l). Also \Ng{U) : G3I = \GL{2,q)\/{2{q-lf) = 
qM2/{2{q - if), so 

^ \NG{U)\-2{q-lf ^ 2g„M„_2(g - 1) 
' ^' gM2 q ' 

Finally G34 = Ga is the pointwise stabilizer of A. Since Gi is 3-transitive on A, |Gi : G34I = 3! = 6. 

So by O: 

I gnM„_3(g - 1)^ 
G34 = ^ . (18) 

It follows from (O, (El), and ([HI) that (0) is satisfied iff 

4g2M„2_2(g^l)^3 _ ^ ^ „_2 

,M„_3(g-l)2 

which holds iff 3(g"-i - 1) < 4g(g"-2 - 1) iff 



3g„M„_i < 2" A; = 4gngM„_2(g"-' - 1) 



_ 4g + 3 > 0. (19) 

This inequality holds when n > 4 or n = 3 and g > 4. 

Since G is transitive on all triples of independent points, all 4-tuples in this example are conjugate to 
each other. 

The Ingleton ratio is 

^ 4qlM^_2{q - If ■ q^ ^ 4g(g"-" - 1) 
g2 . 3g„M„_i • qnMn-siq - If 3(g"-i - 1) ' 

which approaches 4/3 for large q or n. Whereas in the original example p, r{p) = 4(g — l)/(3g), which 

also approaches 4/3 for large q. Thus the two families seem to be roughly equally effective in violating 

Ingleton. 

Example A.8: As usual let F = Fg and G = PGL{n, q), with n > 2. Let Pi, 2 < i < A, be distinct 
but dependent points in V. Thus Pi = Fxi, i = 2,3, for two independent vectors X2,X3 G V, and 
P4 = F{ex2 + X3) for some e £ F. Let U, A, Aj, z = 3, 4, and Gi, 1 < z < 4, be defined the same as 
in Example IA.7I Note that when n = 2 this is our original construction p. 
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From last example, IG2I = gn-^n-i and \Ng{U)\ = qnM2Mn-2/{<l — 1)- Since [/ is a 2-dimensional 
subspace of V , PGL{U) is sharply 3-transitive on the points of U by Lemma IATT] Now as A is a set of 
three distinct points in U, its global stabilizer in PGL{U) is isomorphic to 53. Thus Gi is 3-transitive 

on A and \Ng{U) : Gi| = \GL{2,q)\/ {Q{q - 1)) = qM2/{Q{q - 1)). So 

\NG{U)\-Q{q-l) 6g„M„_2 

q 

Gi is transitive on A, while for i = 3,4, Gj and Gu are both transitive on Aj. G is doubly transitive 
on the points of PG{V). Thus from arguments in Example IA.7I we have |Gi : G12IIG2I = 3g„M„„i, 
Gi = GiiG2i for i = 3,4, and IG3I = IG4I. Also IG3I = 2g„M„_2(g — Since G34 = Ga is of 
index 6 in Gi, by ( |20l ): 

Thus © is satisfied iff 

4g|M|^(q-l)2^ 4g„M„_2(g-l)^ 
• qnMn-2 q 
which holds iff 3g(g"-i - 1) < 4(^ - l)^ iff 

n-2 
i=0 

When n = 2, this inequality holds iff (7 > 4. When n > 2, however, it always fails because Sq'^ — q+A > 
for all q. 

Therefore, the original construction p is the only successful case in this example, with Ingleton ratio 

r{p) = 4{q - l)/{3q). 

Example A.9: Again take G = PGL{n,q) with n > 3. Let U2 be a point of V, Ui, z = 3, 4, distinct 
2-dimensional subspaces of V with U3 H U4 = U2, and f/i = C/3 + U4 the 3-dimensional subspace 
of V generated by C/3 and C/4. Set Gi = NdUi) for 1 < i < 4, and A = (Gj : 1 < i < 4). Then 
all the Gi are parabolics with IG2I = qnMn-i from (fT4l) . IG3I = IG4I = g„M2M„_2/(g — 1), and 
|Gi| = qnM^Mn~3/{q — 1). As Gi is transitive on the {q^ — l)/{q — 1) = q^ + q + \ points in Ui, 
|Gi : G12I = g2 + g + 1, so 



|Gi :Gi2||G2| = (g2 + g + l)g„M, 



n— 1 • 



For z = 3, 4, Gj and Gu are both transitive on the (g^ — — 1) = (7 + ! points in Ui, so Gj = GiiG2i 
for i = 3, 4. Also G34 is the subgroup of G fixing U2 and the points Uz/U2 and U4/U2 of the quotient 
space U1/U2; in particular it is a subgroup of Gi. If we pick a basis = {xs, X2, X4} for f/i such that 
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U2 = {X2) and Ui = {x2,Xi) for i = 3, 4, then elements of G34 correspond to the Unear transformations 
in GL{Ui) whose matrices with respect to Xi take the form 

a 
X h y , 
0c 

where a, 6 and c are nonzero. So |Gi : G34I = \GL{'i,q)\/{q^{q — 1)^) = qM^/{q — Vf, and 

\C \- l^^l ^ gnMsM^.s ■ (g - 1)3 ^ g„M„_3(g - 1)2 
' gM3/(g-l)3 (g-l).gM3 q 

It follows that © is satisfied iff 

{q' + q+ l)<z„M„_i < = qnq{q + l)'(g"-' - 1)M„_2, 

(g - 1)^ • qnMn-3{q -ly 

which holds iff (g^ + g + l)(g"-l - 1) < q{q + l)2(g"-2 _ iff 

9" - 9^ - 9^ + 1 > 0, 

which holds iff n > 4. 
The Ingleton ratio is 

r(A) 



g2M|M2_2.g <^(g + l)2(^n-2_i) 



- 1)2 • (g2 + g + l)g„M„_i • g„M„_3(g - 1)2 (g2 + g + l)(g"-i - 1) ' 
which approaches 1 for large q and {q + 1)2/(^2 _)_ g -|- 1) (which is smaller than 4/3) for large n. So 
this example seems less effective than the other two. 

D. Generalizations in General 2-transitive Groups 

In the following we generaUze the Ingleton violation p in PGL{2,q) to a more abstract construction, 
which includes Examples IA.7I and IA.8I as special cases. 

Let G be a doubly transitive group on a set of order / > 3, let a and f3 be distinct points in il, and 
assume 7 G $7 — {a, /?} such that the global stabilizer G{A) of A = {a, /3, 7} acts as the symmetric group 
on A (which is clearly the case when G is 3-transitive). Let G2 = Ga, G3 = G{a,(3), G4 = G(a,7), 
and Gi = G{A). Set /i = (Gi : 1 < i < 4). 

Let k = \Ga,i3\, d = |Ga|, T the orbit of 7 under the action of Ga,i3, and c = |r|. Observe that 
c = \Ga,i3 '■ Ga| = k/d and c<l — 2asTCQ — {a, (3}. Further c = / — 2 iff G is 3-transitive. 

Since G is 2-transitive on Q, G2 is transitive on 17— {a} and so IG2 : Ga,f3\ = I — I. Also |Gi : G12I = 3 
as Gi is transitive on A, thus 

|Gi :Gi2||G2| =3|G2| =3(/-l)A:. 



45 



Next G3 is conjugate to G4 by 2-transitivity of G and for z = 3, 4, Gj and Gu are both transitive on Aj 
of order 2, so GuG2i = Gi and \Gi\ = 2k for i = 3,4. Finally G34 = Ga is of order d. Thus 

[G3IVIG34I = 4A;Vd = 4A;c, 

so condition © is satisfied iff 3(Z — l)fc < 4kc iff 

3(/ - 1) < 4c. (22) 

Further the Ingleton ratio r(;u) = 4c/(3(/ — 1)). 

If Gis 3-transitive then c = 1-2, so 3(/-l) < 4c = 4(/-2) iff / > 5. Further r(//) = 4(/-2)/(3(/-l)). 

Both Example IA.7I and IA.8I fit in this construction, with p being the only 3-transitive case. In Exam- 
ple |AJl l = {q''- l)/iq - 1) and 

_ (g" - 1) - {q^ - 1) _ g2(gn-2 _ 

so by (Ell), © is satisfied iff 

^ 4g^(g"-2-l) 
g- 1 g- 1 

which gives ([T9l ). In Example IA.8I / has the same value, but since GL{U) is 3-transitive on the (g^ — 
l)/(g - 1) = g + 1 points oiU,c = q + l- 2 = q-l. Then by © is satisfied iff 

- 1 

which gives (1211 ). 

We see that the 3-transitive groups give rise to simple and effective Ingleton violation constructions. This 
category of groups include the alternating and symmetric groups, the groups PGL{2, q) with I = q+l, 
the Mathieu groups, the affine groups of degree 2^ (which are the semidirect product of an e-dimensional 
vector space E over F2 by GL{E)), and the subgroup of the affine group for e = 4 where the complement 
is Aj rather than GL(4, 2) = ^s- 

Appendix B 
Proofs and Calculations in Section [vT] 

A. Structures of M, K, K' , J, J' 

When the characteristic p of Fg equals 2, K = K' and J = J'. So for the analysis of K' and J' we 
only consider the case p ^ 2. 

Observe that \Aa\ = p for each a G , and 

|G|=3, \Bi\=2, \B\ = \B'\ = \P\ = \P'\=q-l. 
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As {CB{f = I, we have M = Dq = S3. It is easy to check that Va G F,,, 

Therefore, AT is a normal subgroup of all K, K', J, J' and 

K = N-{B), K' = N-{B'), J = N-{P), J' = N-{P'). 

Also N trivially intersects each of (B), {B'), (P) and (P'), thus 

K^N x (P), is:' ^ iV XI (P'), J^N x\ (P), J' ^ iV X (P'), 

all of which are semidirect products x: Zq_i. We claim that K = J and K' = J' . Moreover, in the 
case p ^2, all the four groups are isomorphic if and only if 2zi jg even. 

To see this, first consider the bijections a : K J and a' : K' ^ J', where Va G Fg, V/c G JCq, 

a [a^B'^) = A^p-\ a' {A^{B'f) = A^iP')-"- 
Observe that Va, /3 G Fg, VA:, I G ICq, 

a (^A^B'^ ■ A^P') = a (A^+t''^B''+^^ = A^+t^pP~''~^ = A^^p-^ ■ ApP-^ = a (^„P*^) • a (a^P') , 

so a is indeed an isomorphism. Similarly a' is also an isomorphism. 
Next observe that in the case 2, when 2^ is even, 2^ is an integer and so 

q+l 

Thus ^(P')^ j ^ = B' and ((P')^) = (P'). In addition, since F^ is cyclic of an even order q — 1, 

g-1 g+1 / g+1 \ 2 / 

we have — 1 = t 2 , and thus {—t) 2 = U 2 j = i. Consider t : K K , where 

T (AcP'^) = Aa{B'y-^\ Va G F„ VA; G JCq. 

Apparently r is a bijection. Also we can show that it is a homomorphism by calculating r (^q-S*^ • ^^P') 
with the following fact: 

Thus when is even, K = K' and the four groups are all isomorphic. 

When 2^ is odd, however, r is not a bijection anymore, because this time P' ^ ((P')^) and 
r(K) 7^ K'. Furthermore, we can prove that in this case K and K' are not isomorphic, by showing that 
K and J have generahzed flower structures whenever q > 2, whereas if p 7^ 2, K' and J' only have 
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flower structures when "^-^ is even. Since K = J and K' = J', it is enough to only show the analysis of 



K and K' . Pick a G and assume k,l € Kq. Similar to the G2 in Section IV-BI we have the relation 



k = l = 0, 



thus K has a generaUzed flower structure whenever q > 2. On the other hand, for K' we have 



B'^ ^ 


{-If 




"(-ly 0" 








(-l)'a 



which requires k = I and = (—1)'. Thus for p ^ 2, I can only be or If is even, we 
have (—1)^ = 1 and so A; = / = 0, then K' also has a generalized flower structure (as expected since 
here K = K'). If is odd, however, this is not true: in this case (—1)^ = —1, so = Z = or 
in the above relation. Thus Va G F^^, {B') n(^')^° = (--^) = ^2- When q = 3, B' = -I and 
K' = (A) X (-/) ^ Z3 X Z2 = Ze; when q > 3, {B') and are distinct groups but have nontrivial 

intersection. Therefore, in neither case does K' have a generalized flower structure. 



B. Intersections in Instances 8 and 9 

Let p ^ 2. Observe that K' and J' are both subgroups of the G2 in Section lVI-AI so all the intersections 
in both instances are subgroups of their respective counterparts in Section IVI-AI In instance 8, since 
G12 < {tl, Bi) and the (l,l)-entry for every matrix in G2 = K' is always ±1, we have G12 < (— /, Bi). 
This further limits the (2,2)-entry to be ±1 for each matrix in G12. As the (2,2)-entry in K' takes the 
form for some k, we see that this k can only be or By examining the parity of we have 



G 



12 



if IS even 



G 



123 



G 



124 



if IS even 



(-/) ^ Z2 otherwise 



(-/) = Z2 otherwise 
Similarly we can calculate Gi2,Gi23 and G124 for instance 9. 

In both instances, G24 is simply the subgroup of all diagonal matrices in G2, and G23 < T. As matrices 
in K' and J' can be respectively written as 



-11 



1 







1 











= (-1)' 






and 


a' 


{-t)\ 


a' 





1 



a 







-1\A: 



1 

a" {t^^Y 



q+l q-3 

for some a', a" G F^ and A; G /Cg, we see that G23 = {—B^^ ) and {tB^^ ) respectively, where 



-B, 



{tB, 



i-iY 



Thus G23 



in both cases. 
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C. The case p = ?> for Instance 15 

In Instance 15, Gi = M = (C, Bi) and G2 = ( J')^- We can show that G1G2 = G2G1 when p = 3, 
thus Ingleton is satisfied by Condition [3] Observe that G2 = {Xaj \ a € Fg, j € ICq}, where 

(—!)■' — a a 
{-ly -t^ -a P + a 

When p = 3, we have 2 = —1. With this relation, it is easy to check that C = Xi € G2, and for each 
a and j 



X 



X-a,j G G2 



{-ly +a -a 
(_l)i - p + a P - a 

Thus Gi normalizes G2. In particular, VX € G2 and Vy G Gi, we have G G2 and X^'' G G2, 
which imply YX G G1G2 and XY G G2G1 respectively. Therefore, G1G2 = G2G1. 



D. Intersections in Instances 12-15 

Most intersections are easily obtained by comparing the formulae of the matrices in the subgroups 
involved. For the intersection of M with any of , ( J')^, J*^ or ( J')*^, we can utilize the properties 
below to facilitate calculation. Let Cj(X) denote the vector of the i-th column of a matrix X, we have 



Ci{X)+C2{X) 



ci{X)-2c2{X) 



, VX G J^; ci(X) + C2(X) 



,VXgJ^; ci(X)-2c2(X) 



VX G (J')^; 



, VX G (J'f. 



Thus, we need only seek elements of M which share these properties. 

We also want to mention the calculation of G34 for Instances 13 and 15 when p > 3. In Instance 13, 
finding G34 is equivalent to solving the following set of equations: 



a = P 

3/3 = {-ly - i-iy 
f = {-ly 
ti = {-ly 



(-l)J - a = (-1)^ + 2/3 

a = j3 

{-ly -t^ -a = 2{f -2^ - {-ly) 
ti + a = f - 2/3 

From the last two equations, we can see that i and j can only be or if 2zl is even, then 
(— 1)^ = 1, so i and j must both be 0, which yields that G34 = 1. If is odd, then i = implies 
that j = 0, and i = implies that j = In both cases a = /3 = 0, therefore G34 = (— /). For G34 
in Instance 15, we have similar equations and the same discussion also applies. 
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